Jul 06 12:00:27 devstack cinder-volume[75459]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:00:27 devstack cinder-volume[75459]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:00:27 devstack cinder-volume[75459]: we strongly recommend against using it for new projects. Jul 06 12:00:27 devstack cinder-volume[75459]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:00:27 devstack cinder-volume[75459]: framework. For more detail see Jul 06 12:00:27 devstack cinder-volume[75459]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:00:27 devstack cinder-volume[75459]: import eventlet # noqa Jul 06 12:00:30 devstack cinder-volume[75459]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:00:30 devstack cinder-volume[75459]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:00:30 devstack cinder-volume[75459]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:00:31 devstack cinder-volume[75459]: INFO dbcounter [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Registered counter for database cinder Jul 06 12:00:31 devstack cinder-volume[75459]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75459) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:31 devstack cinder-volume[75459]: DEBUG dbcounter [-] [75459] Writer thread running {{(pid=75459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:00:31 devstack cinder-volume[75459]: INFO cinder.rpc [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:00:31 devstack cinder-volume[75459]: INFO cinder.rpc [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:00:31 devstack cinder-volume[75459]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75459) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:31 devstack cinder-volume[75459]: INFO cinder.volume.manager [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Determined volume DB was empty at startup. Jul 06 12:00:31 devstack cinder-volume[75459]: DEBUG cinder.volume.manager [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75459) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:00:31 devstack cinder-volume[75459]: INFO cinder.volume.manager [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 12:00:31 devstack cinder-volume[75459]: WARNING stevedore.named [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:00:31 devstack cinder-volume[75459]: WARNING castellan.key_manager [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:00:31 devstack cinder-volume[75459]: WARNING cinder.keymgr.conf_key_mgr [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:00:31 devstack cinder-volume[75459]: DEBUG cinder.volume.drivers.lvm [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75459) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 12:00:31 devstack cinder-volume[75459]: DEBUG oslo_concurrency.processutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_concurrency.processutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.504s {{(pid=75459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75459) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:32 devstack cinder-volume[75459]: INFO cinder.rpc [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 12:00:32 devstack cinder-volume[75459]: INFO cinder.rpc [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 12:00:32 devstack cinder-volume[75459]: WARNING stevedore.named [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:00:32 devstack cinder-volume[75459]: WARNING castellan.key_manager [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:00:32 devstack cinder-volume[75459]: INFO cinder.volume.manager [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75459) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:32 devstack cinder-volume[75459]: INFO oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Starting 1 workers Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Started child 75627 {{(pid=75459) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Full set of CONF: {{(pid=75459) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] ******************************************************************************** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Configuration options gathered from: {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] ================================================================================ {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] allow_availability_zone_fallback = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] allow_compression_on_image_upload = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] allowed_direct_url_schemes = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] api_rate_limit = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] auth_strategy = keystone {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] az_cache_duration = 3600 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_availability_zone = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_host = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_stats_polling_interval = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backup_api_class = cinder.backup.api.API {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backup_name_template = backup-%s {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backup_use_same_host = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backup_use_temp_snapshot = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] chap_password = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] chap_username = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_internal_tenant_project_id = 7c07b26409cb4c94832a0ec37fddfa26 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_internal_tenant_user_id = 303ece2c4a93418d99d857e3b71aa625 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cloned_volume_same_az = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cluster = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] compression_format = gzip {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] compute_api_class = cinder.compute.nova.API {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] config_dir = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] config_source = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] control_exchange = openstack {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75627]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] debug = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] default_availability_zone = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] default_group_type = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] default_volume_type = lvmdriver-1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] disk_geometry = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] driver_client_cert = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] driver_client_cert_key = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] driver_data_namespace = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] driver_ssl_cert_path = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] driver_ssl_cert_verify = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] driver_use_ssl = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] enable_force_upload = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] enable_new_services = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] enable_unsupported_driver = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] enforce_multipath_for_image_xfer = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] filter_function = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_api_insecure = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_api_ssl_compression = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_ca_certificates_file = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_catalog_info = image:glance:publicURL {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_num_retries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance_request_timeout = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] goodness_function = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] graceful_shutdown_timeout = 5 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] group_api_class = cinder.group.api.API {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] host = devstack {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_compress_on_upload = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_conversion_address_space_limit = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_conversion_cpu_limit = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_conversion_disable = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_upload_use_cinder_backend = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_upload_use_internal_tenant = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_volume_cache_enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_volume_cache_max_count = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] image_volume_cache_max_size_gb = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] init_host_max_objects_retrieval = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] instance_format = [instance: %(uuid)s] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] iscsi_target_flags = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] iscsi_write_cache = on {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] iser_helper = tgtadm {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] iser_ip_address = 192.168.122.235 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] iser_port = 3260 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_color = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_config_append = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_dir = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_file = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_options = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_rotate_interval = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_rotate_interval_type = days {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] log_rotation_type = none {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] max_age = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] max_logfile_count = 30 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] max_logfile_size_mb = 200 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] max_over_subscription_ratio = 20.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] message_reap_interval = 86400 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] message_ttl = 2592000 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] migration_create_volume_timeout_secs = 300 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] monkey_patch = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] monkey_patch_modules = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] my_ip = 192.168.122.235 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] no_snapshot_gb_quota = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] num_iser_scan_tries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] num_shell_tries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] num_volume_device_scan_tries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] nvmeof_conn_info_version = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] nvmet_ns_id = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] nvmet_port_id = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] osapi_max_limit = 1000 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] osapi_volume_ext_list = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] osapi_volume_listen_port = 8776 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] osapi_volume_use_ssl = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] osapi_volume_workers = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] per_volume_size_limit = -1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] periodic_fuzzy_delay = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] periodic_interval = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] public_endpoint = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] publish_errors = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] quota_backup_gigabytes = 1000 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] quota_backups = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] quota_gigabytes = 1000 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] quota_groups = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] quota_snapshots = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] quota_volumes = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] rate_limit_burst = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] rate_limit_except_level = CRITICAL {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] rate_limit_interval = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] reinit_driver_count = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] replication_device = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] report_discard_supported = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] report_interval = 120 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] reservation_clean_interval = 86400 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] reservation_expire = 86400 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] reserved_image_namespaces = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] reserved_percentage = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] rpc_response_timeout = 120 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] run_external_periodic_tasks = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] scst_target_driver = iscsi {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] scst_target_iqn_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_down_time = 720 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] shell_completion = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] snapshot_name_template = snapshot-%s {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] snapshot_same_host = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] split_loggers = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] state_path = /opt/stack/data/cinder {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] storage_availability_zone = nova {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] storage_protocol = iSCSI {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] syslog_log_facility = LOG_USER {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] target_helper = lioadm {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] target_ip_address = 192.168.122.235 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] target_port = 3260 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] target_protocol = iscsi {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] target_secondary_ip_addresses = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] trace_flags = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] transport_url = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] until_refresh = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] use_chap_auth = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] use_default_quota_class = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] use_journal = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] use_json = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] use_multipath_for_image_xfer = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] use_stderr = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] use_syslog = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] verify_glance_signatures = enabled {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_api_class = cinder.volume.api.API {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_backend_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_clear = zero {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_clear_ionice = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_clear_size = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_copy_bps_limit = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_dd_blocksize = 1M {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_name_template = volume-%s {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_service_inithost_offload = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volume_usage_audit_period = month {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] zoning_mode = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.auth_section = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.auth_type = password {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.auth_version = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.cache = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.include_service_catalog = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.insecure = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.interface = public {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_password = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: INFO cinder.volume.manager [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcache_username = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.region_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.service_type = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.backend = dogpile.cache.null {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.backend_argument = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.backend_expiration_time = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.config_prefix = cache.oslo {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.debug_cache_backend = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.enable_retry_client = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.enable_socket_keepalive = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.expiration_time = 600 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.memcache_dead_retry = 300 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.memcache_pool_maxsize = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.memcache_sasl_enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.password = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.proxies = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.redis_db = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.redis_server = localhost:6379 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.retry_attempts = 2 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.retry_delay = 0.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.socket_keepalive_count = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.socket_keepalive_idle = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.socket_keepalive_interval = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.socket_timeout = 1.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.tls_allowed_ciphers = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.tls_cafile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.tls_certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.tls_enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.tls_keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cache.username = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] coordination.backend_url = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.asyncio_connection = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.asyncio_slave_connection = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.backend = sqlalchemy {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.connection = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.connection_debug = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.connection_parameters = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.connection_recycle_time = 3600 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.connection_trace = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.db_inc_retry_interval = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.db_max_retries = 20 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.db_max_retry_interval = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.db_retry_interval = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.max_overflow = 50 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.max_pool_size = 5 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.max_retries = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.pool_timeout = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.retry_interval = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.slave_connection = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.sqlite_synchronous = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.synchronous_reader = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] database.use_db_reconnect = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.connection_string = messaging:// {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.es_doc_type = notification {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.es_scroll_size = 10000 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.es_scroll_time = 2m {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.filter_error_trace = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.hmac_keys = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.sentinel_service_name = mymaster {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.socket_timeout = 0.1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.trace_requests = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler.trace_sqlalchemy = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler_jaeger.process_tags = {} {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] profiler_otlp.service_name_prefix = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.enforce_scope = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.policy_default_rule = default {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.policy_file = policy.yaml {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] privsep_osbrick.group = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] privsep_osbrick.helper_command = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] privsep_osbrick.user = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_sys_admin.group = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_sys_admin.helper_command = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] cinder_sys_admin.user = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.auth_section = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.auth_type = password {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.cafile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.collect_timing = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.insecure = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.send_service_user_token = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.split_loggers = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] service_user.timeout = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.auth_section = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.auth_type = password {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.collect_timing = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.insecure = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.region_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.split_loggers = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] glance.timeout = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.backend_availability_zone = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.chap_password = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.chap_username = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.disk_geometry = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.driver_client_cert = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.driver_client_cert_key = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.driver_data_namespace = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.driver_use_ssl = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.extra_capabilities = {} {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.filter_function = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.goodness_function = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.iscsi_target_flags = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.iscsi_write_cache = on {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.iser_helper = tgtadm {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.iser_port = 3260 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.lvm_share_target = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.lvm_type = auto {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.num_shell_tries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.replication_device = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.report_discard_supported = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.reserved_percentage = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.target_helper = tgtadm {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.target_port = 3260 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.target_protocol = iscsi {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.trace_flags = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.unique_fqdn_network = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.use_chap_auth = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_backend_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_clear = zero {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_clear_ionice = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_clear_size = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_reports.file_event_handler = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_reports.log_dir = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.backend_host = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.chap_password = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.chap_username = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.disk_geometry = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.driver_client_cert = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack sudo[75631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.extra_capabilities = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.filter_function = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.goodness_function = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack sudo[75631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.iser_helper = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.iser_ip_address = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.iser_port = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.lvm_share_target = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.lvm_type = auto {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.num_shell_tries = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.replication_device = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.report_discard_supported = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.reserved_percentage = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.scst_target_driver = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.storage_protocol = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.target_helper = lioadm {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.target_ip_address = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.target_port = 3260 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.trace_flags = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.use_chap_auth = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_clear = zero {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_clear_size = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] lvmdriver-1.volumes_dir = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.ssl = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_notifications.driver = [] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] key_manager.fixed_key = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.barbican_api_version = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.barbican_endpoint = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.barbican_endpoint_type = public {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.barbican_region_name = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.cafile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.collect_timing = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.insecure = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.number_of_retries = 60 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.retry_delay = 1 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.send_service_user_token = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.split_loggers = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.timeout = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.verify_ssl = True {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican.verify_ssl_path = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.auth_section = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.auth_type = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.cafile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.certfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.collect_timing = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.insecure = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.keyfile = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.split_loggers = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] barbican_service_user.timeout = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.approle_role_id = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.approle_secret_id = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.kv_mountpoint = secret {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.kv_path = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.kv_version = 2 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.namespace = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.root_token_id = **** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.ssl_ca_crt_file = None {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.timeout = 60.0 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.use_ssl = False {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:00:32 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] ******************************************************************************** {{(pid=75459) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:00:33 devstack sudo[75631]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:33 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.767s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:33 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:33 devstack sudo[75685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:33 devstack sudo[75685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:34 devstack sudo[75685]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.699s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:00:34 devstack cinder-volume[75627]: INFO cinder.brick.local_dev.lvm [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:34 devstack sudo[75922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:34 devstack sudo[75922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:34 devstack sudo[75922]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG cinder.brick.local_dev.lvm [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75627) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 12:00:34 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:35 devstack sudo[76109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:35 devstack sudo[76109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:36 devstack sudo[76109]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.039s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:36 devstack sudo[76318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:36 devstack sudo[76318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:36 devstack sudo[76318]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.788s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:36 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:36 devstack sudo[76411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 12:00:36 devstack sudo[76411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:37 devstack sudo[76411]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:37 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.752s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:37 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:37 devstack sudo[76414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:37 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:38 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:38 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:38 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:38 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:38 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:39 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:39 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.825s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:39 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:39 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:39 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:40 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:40 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.816s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:40 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:40 devstack sudo[76436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:40 devstack sudo[76436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:40 devstack sudo[76436]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:40 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:40 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:40 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:40 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:40 devstack sudo[76444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:40 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:41 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:41 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:41 devstack cinder-volume[75627]: INFO cinder.volume.drivers.lvm [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 12:00:41 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:41 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:41 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:41 devstack sudo[76448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:41 devstack sudo[76448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:42 devstack sudo[76448]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:42 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:42 devstack cinder-volume[75627]: DEBUG cinder.volume.drivers.lvm [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Updating volume stats {{(pid=75627) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:00:42 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:42 devstack sudo[76468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:42 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:42 devstack cinder-volume[75459]: DEBUG dbcounter [-] [75459] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:00:42 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:42 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:42 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:42 devstack sudo[76574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:42 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:43 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:43 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:43 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:43 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:43 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:43 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:43 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:43 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:44 devstack sudo[76719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:44 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:44 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:44 devstack cinder-volume[75627]: INFO cinder.volume.driver [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG cinder.volume.driver [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75627) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG oslo_db.sqlalchemy.engines [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG dbcounter [-] [75627] Writer thread running {{(pid=75627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG cinder.db.api [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Building query based on filter {{(pid=75627) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG cinder.image.image_utils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75627) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:00:44 devstack cinder-volume[75627]: INFO cinder.keymgr.migration [None req-78017b45-0ffc-40c6-82db-c4a70b3d7607 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG cinder.volume.drivers.lvm [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Updating volume stats {{(pid=75627) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:00:44 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:44 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:44 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:45 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:45 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:45 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:45 devstack sudo[76730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:45 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:46 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:46 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:46 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:46 devstack sudo[76733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:46 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:46 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:46 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:46 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:46 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:46 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:47 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:47 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:47 devstack cinder-volume[75627]: DEBUG cinder.manager [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Notifying Schedulers of capabilities ... {{(pid=75627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:00:47 devstack cinder-volume[75627]: INFO cinder.volume.manager [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Driver initialization completed successfully. Jul 06 12:00:47 devstack cinder-volume[75627]: INFO cinder.manager [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Initiating service 2 cleanup Jul 06 12:00:47 devstack cinder-volume[75627]: INFO cinder.manager [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Service 2 cleanup completed. Jul 06 12:00:47 devstack cinder-volume[75627]: DEBUG cinder.service [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Creating RPC server for service cinder-volume {{(pid=75627) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:00:47 devstack cinder-volume[75627]: DEBUG cinder.service [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75627) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:00:47 devstack cinder-volume[75627]: INFO cinder.volume.manager [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 12:00:47 devstack cinder-volume[75627]: DEBUG cinder.volume.drivers.lvm [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Updating volume stats {{(pid=75627) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:00:47 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:47 devstack sudo[76740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:00:47 devstack sudo[76740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:48 devstack sudo[76740]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:48 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:48 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:48 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:48 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:48 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:48 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:48 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:49 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:00:49 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:49 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:49 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.738s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:49 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:00:49 devstack sudo[76753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:00:49 devstack sudo[76753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:00:50 devstack sudo[76753]: pam_unix(sudo:session): session closed for user root Jul 06 12:00:50 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:00:50 devstack cinder-volume[75627]: INFO cinder.volume.manager [None req-da220e96-49cc-43b2-9fa2-1f6cc5508288 None None] Driver post RPC initialization completed successfully. Jul 06 12:00:57 devstack cinder-volume[75627]: DEBUG dbcounter [-] [75627] Writing DB stats cinder:SELECT=2 {{(pid=75627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:01:00 devstack cinder-volume[75627]: DEBUG dbcounter [-] [75627] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:01:24 devstack cinder-volume[75627]: DEBUG oslo_service.periodic_task [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running periodic task VolumeManager._thread_info {{(pid=75627) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:01:24 devstack cinder-volume[75627]: DEBUG cinder.volume.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] thread count: 6 {{(pid=75627) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:01:24 devstack cinder-volume[75627]: DEBUG cinder.volume.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] thread info: [<_MainThread(MainThread, started 126011159601280)>, , , , , ] {{(pid=75627) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:02:24 devstack cinder-volume[75627]: DEBUG oslo_service.periodic_task [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75627) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:02:24 devstack cinder-volume[75627]: DEBUG cinder.volume.drivers.lvm [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Updating volume stats {{(pid=75627) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:02:24 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:24 devstack sudo[81700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:24 devstack sudo[81700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:25 devstack sudo[81700]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:25 devstack sudo[81719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:25 devstack sudo[81719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:25 devstack sudo[81719]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:25 devstack sudo[81722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:25 devstack sudo[81722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:26 devstack sudo[81722]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:26 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:26 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:26 devstack sudo[81725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:26 devstack sudo[81725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:27 devstack sudo[81725]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:27 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:27 devstack cinder-volume[75627]: DEBUG cinder.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Notifying Schedulers of capabilities ... {{(pid=75627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:02:27 devstack cinder-volume[75627]: DEBUG oslo_service.periodic_task [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running periodic task VolumeManager._thread_info {{(pid=75627) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:02:27 devstack cinder-volume[75627]: DEBUG cinder.volume.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] thread count: 6 {{(pid=75627) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:02:27 devstack cinder-volume[75627]: DEBUG cinder.volume.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] thread info: [<_MainThread(MainThread, started 126011159601280)>, , , , , ] {{(pid=75627) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:03:00 devstack cinder-volume[75627]: DEBUG dbcounter [-] [75627] Writing DB stats cinder:SELECT=1 {{(pid=75627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:03:00 devstack cinder-volume[75627]: DEBUG dbcounter [-] [75627] Writing DB stats cinder:UPDATE=1 {{(pid=75627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:03:24 devstack cinder-volume[75627]: DEBUG oslo_service.periodic_task [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75627) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:03:24 devstack cinder-volume[75627]: DEBUG cinder.volume.drivers.lvm [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Updating volume stats {{(pid=75627) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:03:24 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:24 devstack sudo[83211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:03:24 devstack sudo[83211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:25 devstack sudo[83211]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:25 devstack sudo[83227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:03:25 devstack sudo[83227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:25 devstack sudo[83227]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:25 devstack sudo[83257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:03:25 devstack sudo[83257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:26 devstack sudo[83257]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:26 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:26 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:26 devstack sudo[83280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:03:26 devstack sudo[83280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:27 devstack sudo[83280]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:27 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:27 devstack cinder-volume[75627]: DEBUG cinder.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Notifying Schedulers of capabilities ... {{(pid=75627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:03:27 devstack cinder-volume[75627]: DEBUG oslo_service.periodic_task [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running periodic task VolumeManager._thread_info {{(pid=75627) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:03:27 devstack cinder-volume[75627]: DEBUG cinder.volume.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] thread count: 6 {{(pid=75627) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:03:27 devstack cinder-volume[75627]: DEBUG cinder.volume.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] thread info: [<_MainThread(MainThread, started 126011159601280)>, , , , , ] {{(pid=75627) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:04:24 devstack cinder-volume[75627]: DEBUG oslo_service.periodic_task [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75627) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:04:24 devstack cinder-volume[75627]: DEBUG cinder.volume.drivers.lvm [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Updating volume stats {{(pid=75627) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:04:24 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:24 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:04:24 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:25 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:25 devstack sudo[84715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:04:25 devstack sudo[84715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:25 devstack sudo[84715]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:25 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:25 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:04:25 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:26 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:26 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:26 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:26 devstack sudo[84725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:04:26 devstack sudo[84725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:27 devstack sudo[84725]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:27 devstack cinder-volume[75627]: DEBUG oslo_concurrency.processutils [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=75627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:27 devstack cinder-volume[75627]: DEBUG cinder.manager [None req-9c3d91fe-852f-4500-a205-2333988654f2 None None] Notifying Schedulers of capabilities ... {{(pid=75627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:00 devstack cinder-volume[75627]: DEBUG dbcounter [-] [75627] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:05:10 devstack cinder-volume[75459]: INFO oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Caught SIGTERM, stopping children Jul 06 12:05:10 devstack cinder-volume[75459]: DEBUG oslo_concurrency.lockutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Acquiring lock "singleton_lock" {{(pid=75459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:10 devstack cinder-volume[75459]: DEBUG oslo_concurrency.lockutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Acquired lock "singleton_lock" {{(pid=75459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:10 devstack cinder-volume[75459]: DEBUG oslo_concurrency.lockutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Releasing lock "singleton_lock" {{(pid=75459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:10 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Stop services. {{(pid=75459) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 12:05:10 devstack cinder-volume[75459]: DEBUG oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Killing children. {{(pid=75459) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 12:05:10 devstack cinder-volume[75459]: INFO oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Waiting on 1 children to exit Jul 06 12:05:12 devstack cinder-volume[75627]: DEBUG oslo_concurrency.lockutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Acquiring lock "singleton_lock" {{(pid=75627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:12 devstack cinder-volume[75627]: DEBUG oslo_concurrency.lockutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Acquired lock "singleton_lock" {{(pid=75627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:12 devstack cinder-volume[75627]: DEBUG oslo_concurrency.lockutils [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Releasing lock "singleton_lock" {{(pid=75627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:12 devstack cinder-volume[75627]: WARNING amqp [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:12 devstack cinder-volume[75627]: WARNING amqp [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:12 devstack cinder-volume[75459]: INFO oslo_service.backend._eventlet.service [None req-4fe583d5-4bfc-4a8c-9483-6481438b5ac9 None None] Child 75627 exited with status 0 Jul 06 12:05:13 devstack cinder-volume[85737]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:05:13 devstack cinder-volume[85737]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:05:13 devstack cinder-volume[85737]: we strongly recommend against using it for new projects. Jul 06 12:05:13 devstack cinder-volume[85737]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:05:13 devstack cinder-volume[85737]: framework. For more detail see Jul 06 12:05:13 devstack cinder-volume[85737]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:05:13 devstack cinder-volume[85737]: import eventlet # noqa Jul 06 12:05:15 devstack cinder-volume[85737]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85737) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:15 devstack cinder-volume[85737]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85737) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:15 devstack cinder-volume[85737]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85737) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:15 devstack cinder-volume[85737]: INFO dbcounter [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Registered counter for database cinder Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_db.sqlalchemy.engines [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85737) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG dbcounter [-] [85737] Writer thread running {{(pid=85737) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:16 devstack cinder-volume[85737]: INFO cinder.rpc [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:05:16 devstack cinder-volume[85737]: INFO cinder.rpc [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_db.sqlalchemy.engines [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85737) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:16 devstack cinder-volume[85737]: INFO cinder.volume.manager [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Determined volume DB was empty at startup. Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG cinder.volume.manager [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85737) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:05:16 devstack cinder-volume[85737]: INFO cinder.volume.manager [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 12:05:16 devstack cinder-volume[85737]: WARNING stevedore.named [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:05:16 devstack cinder-volume[85737]: WARNING castellan.key_manager [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:16 devstack cinder-volume[85737]: WARNING cinder.keymgr.conf_key_mgr [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:16 devstack cinder-volume[85737]: INFO cinder.volume.manager [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_db.sqlalchemy.engines [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85737) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:16 devstack cinder-volume[85737]: INFO oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Starting 1 workers Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Started child 85968 {{(pid=85737) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Full set of CONF: {{(pid=85737) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] ******************************************************************************** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Configuration options gathered from: {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] ================================================================================ {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:05:16 devstack cinder-volume[85968]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] allow_availability_zone_fallback = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] allow_compression_on_image_upload = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] allowed_direct_url_schemes = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] api_rate_limit = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] auth_strategy = keystone {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_availability_zone = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_host = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_stats_polling_interval = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backup_api_class = cinder.backup.api.API {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backup_name_template = backup-%s {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backup_use_same_host = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backup_use_temp_snapshot = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] chap_password = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] chap_username = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_internal_tenant_project_id = 7c07b26409cb4c94832a0ec37fddfa26 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_internal_tenant_user_id = 303ece2c4a93418d99d857e3b71aa625 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cluster = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] compression_format = gzip {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] compute_api_class = cinder.compute.nova.API {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] config_dir = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] config_source = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] control_exchange = openstack {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] debug = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] default_availability_zone = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] default_group_type = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] default_volume_type = QuobyteHD {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] disk_geometry = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] driver_client_cert = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] driver_client_cert_key = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] driver_data_namespace = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] driver_ssl_cert_path = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] driver_ssl_cert_verify = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] driver_use_ssl = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] enable_new_services = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] enable_unsupported_driver = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] enabled_backends = ['QuobyteHD'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] enforce_multipath_for_image_xfer = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] filter_function = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_api_insecure = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_api_ssl_compression = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_ca_certificates_file = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_catalog_info = image:glance:publicURL {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_num_retries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance_request_timeout = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] goodness_function = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] graceful_shutdown_timeout = 5 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] group_api_class = cinder.group.api.API {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] host = devstack {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_compress_on_upload = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_conversion_address_space_limit = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_conversion_cpu_limit = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_conversion_disable = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_upload_use_cinder_backend = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_upload_use_internal_tenant = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_volume_cache_enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_volume_cache_max_count = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] image_volume_cache_max_size_gb = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] init_host_max_objects_retrieval = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] instance_format = [instance: %(uuid)s] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] iscsi_target_flags = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] iscsi_write_cache = on {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] iser_helper = tgtadm {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] iser_ip_address = 192.168.122.235 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] iser_port = 3260 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85968]: INFO cinder.volume.manager [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.remotefs [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85968) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_color = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_config_append = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_dir = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_file = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_options = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_rotate_interval = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_rotate_interval_type = days {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] log_rotation_type = none {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] max_age = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] max_logfile_count = 30 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] max_logfile_size_mb = 200 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] max_over_subscription_ratio = 20.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] message_reap_interval = 86400 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] message_ttl = 2592000 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] migration_create_volume_timeout_secs = 300 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] monkey_patch = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] monkey_patch_modules = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] my_ip = 192.168.122.235 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] no_snapshot_gb_quota = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] num_iser_scan_tries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] num_shell_tries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] num_volume_device_scan_tries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] nvmeof_conn_info_version = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] nvmet_ns_id = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] nvmet_port_id = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] osapi_max_limit = 1000 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] osapi_volume_ext_list = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] osapi_volume_listen_port = 8776 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] osapi_volume_use_ssl = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] osapi_volume_workers = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] per_volume_size_limit = -1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] periodic_fuzzy_delay = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] periodic_interval = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] public_endpoint = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] publish_errors = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] quota_backup_gigabytes = 1000 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] quota_backups = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] quota_gigabytes = 1000 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] quota_groups = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] quota_snapshots = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] quota_volumes = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] rate_limit_burst = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] rate_limit_except_level = CRITICAL {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] rate_limit_interval = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] reinit_driver_count = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] replication_device = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] report_discard_supported = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] report_interval = 120 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] reservation_clean_interval = 86400 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] reservation_expire = 86400 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] reserved_image_namespaces = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] reserved_percentage = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] rpc_response_timeout = 120 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] run_external_periodic_tasks = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] scst_target_driver = iscsi {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] scst_target_iqn_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_down_time = 720 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] shell_completion = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] snapshot_name_template = snapshot-%s {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] split_loggers = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] state_path = /opt/stack/data/cinder {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] storage_availability_zone = nova {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] storage_protocol = iSCSI {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] syslog_log_facility = LOG_USER {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] target_helper = lioadm {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] target_ip_address = 192.168.122.235 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] target_port = 3260 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] target_protocol = iscsi {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] target_secondary_ip_addresses = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] trace_flags = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] transport_url = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] until_refresh = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] use_chap_auth = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] use_default_quota_class = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] use_journal = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] use_json = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85968) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 12:05:16 devstack cinder-volume[85968]: WARNING cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 12:05:16 devstack cinder-volume[85968]: WARNING cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Running cmd (subprocess): mount.quobyte {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] use_multipath_for_image_xfer = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] use_stderr = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] use_syslog = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] verify_glance_signatures = enabled {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_api_class = cinder.volume.api.API {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_backend_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_clear = zero {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_clear_ionice = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_clear_size = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_copy_bps_limit = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_dd_blocksize = 1M {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_name_template = volume-%s {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_service_inithost_offload = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volume_usage_audit_period = month {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] zoning_mode = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_concurrency.disable_process_locking = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.auth_section = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.auth_type = password {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.auth_version = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.cache = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.include_service_catalog = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.insecure = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.interface = public {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_password = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcache_username = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.region_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.service_type = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.backend = dogpile.cache.null {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.backend_argument = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.backend_expiration_time = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.config_prefix = cache.oslo {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.debug_cache_backend = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.enable_retry_client = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.enable_socket_keepalive = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.expiration_time = 600 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.hashclient_retry_attempts = 2 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.memcache_dead_retry = 300 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.memcache_pool_maxsize = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.memcache_sasl_enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.password = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.proxies = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack quobyte-client[85973]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 12:05:16 devstack quobyte-client[85973]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.redis_db = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=85968) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.redis_server = localhost:6379 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85968]: INFO cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a ... Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.retry_attempts = 2 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.retry_delay = 0.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 -c /etc/quobyte/client-cinder.cfg {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.socket_keepalive_count = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.socket_keepalive_idle = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.socket_keepalive_interval = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.socket_timeout = 1.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.tls_allowed_ciphers = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.tls_cafile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.tls_certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.tls_enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.tls_keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cache.username = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] coordination.backend_url = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.asyncio_connection = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.asyncio_slave_connection = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.backend = sqlalchemy {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.connection = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.connection_debug = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.connection_parameters = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.connection_recycle_time = 3600 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.connection_trace = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.db_inc_retry_interval = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.db_max_retries = 20 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.db_max_retry_interval = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.db_retry_interval = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.max_overflow = 50 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.max_pool_size = 5 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.max_retries = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.mysql_wsrep_sync_wait = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.pool_timeout = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 -c /etc/quobyte/client-cinder.cfg Jul 06 12:05:16 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.retry_interval = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.slave_connection = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.sqlite_synchronous = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.synchronous_reader = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] database.use_db_reconnect = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.connection_string = messaging:// {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:16 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.es_doc_type = notification {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.es_scroll_size = 10000 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.es_scroll_time = 2m {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.filter_error_trace = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.hmac_keys = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.sentinel_service_name = mymaster {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.socket_timeout = 0.1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.trace_requests = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler.trace_sqlalchemy = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler_jaeger.process_tags = {} {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler_jaeger.service_name_prefix = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] profiler_otlp.service_name_prefix = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.enforce_new_defaults = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.enforce_scope = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.policy_default_rule = default {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.policy_file = policy.yaml {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] privsep_osbrick.group = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] privsep_osbrick.helper_command = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] privsep_osbrick.user = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_sys_admin.group = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_sys_admin.helper_command = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] cinder_sys_admin.user = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.auth_section = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.auth_type = password {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.cafile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.collect_timing = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.insecure = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.send_service_user_token = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.split_loggers = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] service_user.timeout = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.auth_section = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.auth_type = password {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.collect_timing = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.insecure = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.region_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.split_loggers = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] glance.timeout = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.backend_availability_zone = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.chap_password = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.chap_username = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.disk_geometry = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.driver_client_cert = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.driver_client_cert_key = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.driver_data_namespace = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.driver_use_ssl = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.extra_capabilities = {} {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.filter_function = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.goodness_function = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.iscsi_target_flags = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.iscsi_write_cache = on {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.iser_helper = tgtadm {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.iser_port = 3260 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_host = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_login = admin {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_mount_options = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_password = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_private_key = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_share_path = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.num_shell_tries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.quobyte_volume_url = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.replication_device = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.report_discard_supported = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.reserved_percentage = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.target_helper = tgtadm {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.target_port = 3260 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.target_protocol = iscsi {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.trace_flags = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.unique_fqdn_network = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.use_chap_auth = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_backend_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_clear = zero {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_clear_ionice = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_clear_size = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_reports.file_event_handler = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_reports.log_dir = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.backend_availability_zone = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.backend_host = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.chap_password = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.chap_username = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.chiscsi_conf = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.disk_geometry = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.driver_client_cert = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.driver_data_namespace = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.driver_use_ssl = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.extra_capabilities = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.filter_function = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.goodness_function = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.iser_helper = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.iser_ip_address = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.iser_port = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.iser_target_prefix = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_host = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_login = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_mount_options = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_password = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_private_key = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_share_path = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_ssh_port = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.num_shell_tries = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.nvmet_port_id = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.replication_device = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.report_discard_supported = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.reserved_percentage = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.scst_target_driver = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.storage_protocol = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.target_helper = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.target_ip_address = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.target_port = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.target_prefix = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.target_protocol = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.trace_flags = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.use_chap_auth = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_clear = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_clear_size = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] QuobyteHD.volumes_dir = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.ssl = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_notifications.driver = [] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_notifications.retry = -1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] key_manager.fixed_key = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.barbican_api_version = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.barbican_endpoint = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.barbican_endpoint_type = public {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.barbican_region_name = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.cafile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.collect_timing = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.insecure = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.number_of_retries = 60 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.retry_delay = 1 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.send_service_user_token = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.split_loggers = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.timeout = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.verify_ssl = True {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican.verify_ssl_path = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.auth_section = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.auth_type = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.cafile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.certfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.collect_timing = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.insecure = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.keyfile = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.split_loggers = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] barbican_service_user.timeout = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.approle_role_id = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.approle_secret_id = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.kv_mountpoint = secret {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.kv_path = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.kv_version = 2 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.namespace = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.root_token_id = **** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.ssl_ca_crt_file = None {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.timeout = 60.0 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.use_ssl = False {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:17 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] ******************************************************************************** {{(pid=85737) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:05:17 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:17 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.759s {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:17 devstack cinder-volume[85968]: INFO cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a succeeded Jul 06 12:05:17 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=85968) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:17 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.769s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:17 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:17 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:05:17 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:18 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.615s {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:18 devstack cinder-volume[85968]: INFO cinder.volume.driver [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG cinder.volume.driver [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85968) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG oslo_db.sqlalchemy.engines [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85968) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG dbcounter [-] [85968] Writer thread running {{(pid=85968) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG cinder.db.api [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Building query based on filter {{(pid=85968) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG cinder.image.image_utils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85968) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:05:18 devstack cinder-volume[85968]: INFO cinder.keymgr.migration [None req-cabb71cf-589e-4aa5-b620-fd38eab09af5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=85968) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=85968) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:18 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:18 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:05:18 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:19 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.612s {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG cinder.manager [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Notifying Schedulers of capabilities ... {{(pid=85968) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:19 devstack cinder-volume[85968]: INFO cinder.volume.manager [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Driver initialization completed successfully. Jul 06 12:05:19 devstack cinder-volume[85968]: INFO cinder.manager [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Initiating service 3 cleanup Jul 06 12:05:19 devstack cinder-volume[85968]: INFO cinder.manager [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Service 3 cleanup completed. Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG cinder.service [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Creating RPC server for service cinder-volume {{(pid=85968) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG cinder.service [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85968) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:05:19 devstack cinder-volume[85968]: INFO cinder.volume.manager [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=85968) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=85968) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:19 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:19 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:05:19 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:20 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:20 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.826s {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:20 devstack cinder-volume[85968]: INFO cinder.volume.manager [None req-2ddb3c4e-602e-4a3f-9663-4e8f8dcce045 None None] Driver post RPC initialization completed successfully. Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-311eb128-6b30-411b-9298-115925adba9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-311eb128-6b30-411b-9298-115925adba9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-311eb128-6b30-411b-9298-115925adba9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=85968) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG cinder.volume.drivers.quobyte [None req-311eb128-6b30-411b-9298-115925adba9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=85968) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-311eb128-6b30-411b-9298-115925adba9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85968) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-311eb128-6b30-411b-9298-115925adba9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:24 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:05:24 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:24 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG oslo_concurrency.processutils [None req-311eb128-6b30-411b-9298-115925adba9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.596s {{(pid=85968) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:24 devstack cinder-volume[85968]: DEBUG cinder.manager [None req-311eb128-6b30-411b-9298-115925adba9a None None] Notifying Schedulers of capabilities ... {{(pid=85968) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:26 devstack cinder-volume[85737]: INFO oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Caught SIGTERM, stopping children Jul 06 12:05:26 devstack cinder-volume[85737]: DEBUG oslo_concurrency.lockutils [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Acquiring lock "singleton_lock" {{(pid=85737) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:26 devstack cinder-volume[85737]: DEBUG oslo_concurrency.lockutils [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Acquired lock "singleton_lock" {{(pid=85737) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:26 devstack cinder-volume[85737]: DEBUG oslo_concurrency.lockutils [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Releasing lock "singleton_lock" {{(pid=85737) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:26 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Stop services. {{(pid=85737) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 12:05:26 devstack cinder-volume[85737]: DEBUG oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Killing children. {{(pid=85737) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 12:05:26 devstack cinder-volume[85737]: INFO oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Waiting on 1 children to exit Jul 06 12:05:27 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Acquiring lock "singleton_lock" {{(pid=85968) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:27 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Acquired lock "singleton_lock" {{(pid=85968) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:27 devstack cinder-volume[85968]: DEBUG oslo_concurrency.lockutils [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Releasing lock "singleton_lock" {{(pid=85968) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:27 devstack cinder-volume[85968]: WARNING amqp [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:27 devstack cinder-volume[85968]: WARNING amqp [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:05:27 devstack cinder-volume[85737]: INFO oslo_service.backend._eventlet.service [None req-eb697b10-7a56-4fb4-9240-3e318270c591 None None] Child 85968 exited with status 0 Jul 06 12:05:28 devstack cinder-volume[86386]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:05:28 devstack cinder-volume[86386]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:05:28 devstack cinder-volume[86386]: we strongly recommend against using it for new projects. Jul 06 12:05:28 devstack cinder-volume[86386]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:05:28 devstack cinder-volume[86386]: framework. For more detail see Jul 06 12:05:28 devstack cinder-volume[86386]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:05:28 devstack cinder-volume[86386]: import eventlet # noqa Jul 06 12:05:31 devstack cinder-volume[86386]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86386) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:05:31 devstack cinder-volume[86386]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86386) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:05:31 devstack cinder-volume[86386]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86386) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:05:32 devstack cinder-volume[86386]: INFO dbcounter [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Registered counter for database cinder Jul 06 12:05:32 devstack cinder-volume[86386]: DEBUG oslo_db.sqlalchemy.engines [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86386) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG dbcounter [-] [86386] Writer thread running {{(pid=86386) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:33 devstack cinder-volume[86386]: INFO cinder.rpc [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:05:33 devstack cinder-volume[86386]: INFO cinder.rpc [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_db.sqlalchemy.engines [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86386) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:33 devstack cinder-volume[86386]: INFO cinder.volume.manager [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Determined volume DB was empty at startup. Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG cinder.volume.manager [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86386) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:05:33 devstack cinder-volume[86386]: WARNING stevedore.named [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:05:33 devstack cinder-volume[86386]: WARNING castellan.key_manager [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:33 devstack cinder-volume[86386]: WARNING cinder.keymgr.conf_key_mgr [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:05:33 devstack cinder-volume[86386]: INFO cinder.volume.manager [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_db.sqlalchemy.engines [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86386) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:33 devstack cinder-volume[86386]: INFO oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Starting 1 workers Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Started child 86706 {{(pid=86386) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Full set of CONF: {{(pid=86386) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] ******************************************************************************** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] Configuration options gathered from: {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] ================================================================================ {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] allow_availability_zone_fallback = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] allow_compression_on_image_upload = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] allowed_direct_url_schemes = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] api_rate_limit = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] auth_strategy = keystone {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_availability_zone = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_host = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_stats_polling_interval = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backup_api_class = cinder.backup.api.API {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86706]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backup_name_template = backup-%s {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backup_use_same_host = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backup_use_temp_snapshot = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] chap_password = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] chap_username = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_internal_tenant_project_id = 7c07b26409cb4c94832a0ec37fddfa26 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_internal_tenant_user_id = 303ece2c4a93418d99d857e3b71aa625 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cluster = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] compression_format = gzip {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] compute_api_class = cinder.compute.nova.API {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] config_dir = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] config_source = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] control_exchange = openstack {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] debug = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] default_availability_zone = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] default_group_type = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] default_volume_type = QuobyteHD {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] disk_geometry = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] driver_client_cert = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] driver_client_cert_key = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] driver_data_namespace = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] driver_ssl_cert_path = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] driver_ssl_cert_verify = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] driver_use_ssl = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] enable_new_services = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] enable_unsupported_driver = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] enabled_backends = ['QuobyteHD'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] enforce_multipath_for_image_xfer = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] filter_function = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_api_insecure = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_api_ssl_compression = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_ca_certificates_file = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_catalog_info = image:glance:publicURL {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_num_retries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance_request_timeout = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] goodness_function = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] graceful_shutdown_timeout = 5 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] group_api_class = cinder.group.api.API {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] host = devstack {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_compress_on_upload = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_conversion_address_space_limit = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_conversion_cpu_limit = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_conversion_disable = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_upload_use_cinder_backend = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_upload_use_internal_tenant = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_volume_cache_enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_volume_cache_max_count = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] image_volume_cache_max_size_gb = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] init_host_max_objects_retrieval = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] instance_format = [instance: %(uuid)s] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] iscsi_target_flags = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] iscsi_write_cache = on {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] iser_helper = tgtadm {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] iser_ip_address = 192.168.122.235 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] iser_port = 3260 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 12:05:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86706) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_color = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_config_append = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_dir = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_file = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_options = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_rotate_interval = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_rotate_interval_type = days {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] log_rotation_type = none {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] max_age = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] max_logfile_count = 30 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] max_logfile_size_mb = 200 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] max_over_subscription_ratio = 20.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] message_reap_interval = 86400 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] message_ttl = 2592000 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] migration_create_volume_timeout_secs = 300 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] monkey_patch = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] monkey_patch_modules = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] my_ip = 192.168.122.235 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] no_snapshot_gb_quota = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] num_iser_scan_tries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] num_shell_tries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] num_volume_device_scan_tries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] nvmeof_conn_info_version = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] nvmet_ns_id = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] nvmet_port_id = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] osapi_max_limit = 1000 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] osapi_volume_ext_list = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] osapi_volume_listen_port = 8776 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] osapi_volume_use_ssl = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] osapi_volume_workers = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] per_volume_size_limit = -1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] periodic_fuzzy_delay = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] periodic_interval = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] public_endpoint = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] publish_errors = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] quota_backup_gigabytes = 1000 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] quota_backups = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] quota_gigabytes = 1000 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] quota_groups = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] quota_snapshots = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] quota_volumes = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] rate_limit_burst = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] rate_limit_except_level = CRITICAL {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] rate_limit_interval = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] reinit_driver_count = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] replication_device = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] report_discard_supported = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] report_interval = 120 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] reservation_clean_interval = 86400 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] reservation_expire = 86400 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] reserved_image_namespaces = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] reserved_percentage = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] rpc_response_timeout = 120 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] run_external_periodic_tasks = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] scst_target_driver = iscsi {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] scst_target_iqn_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_down_time = 720 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] shell_completion = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] snapshot_name_template = snapshot-%s {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] split_loggers = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] state_path = /opt/stack/data/cinder {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] storage_availability_zone = nova {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] storage_protocol = iSCSI {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] syslog_log_facility = LOG_USER {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] target_helper = lioadm {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] target_ip_address = 192.168.122.235 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] target_port = 3260 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] target_protocol = iscsi {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] target_secondary_ip_addresses = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] trace_flags = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] transport_url = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] until_refresh = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] use_chap_auth = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] use_default_quota_class = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] use_journal = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] use_json = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] use_multipath_for_image_xfer = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] use_stderr = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] use_syslog = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] verify_glance_signatures = enabled {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_api_class = cinder.volume.api.API {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_backend_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_clear = zero {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_clear_ionice = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_clear_size = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_copy_bps_limit = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_dd_blocksize = 1M {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_name_template = volume-%s {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_service_inithost_offload = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volume_usage_audit_period = month {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] zoning_mode = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_concurrency.disable_process_locking = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.auth_section = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.auth_type = password {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.auth_version = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.cache = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.include_service_catalog = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.insecure = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.interface = public {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_password = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcache_username = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.region_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.service_type = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.backend = dogpile.cache.null {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.backend_argument = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.backend_expiration_time = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.config_prefix = cache.oslo {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.debug_cache_backend = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.enable_retry_client = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.enable_socket_keepalive = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.expiration_time = 600 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.hashclient_retry_attempts = 2 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.memcache_dead_retry = 300 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.memcache_pool_maxsize = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.memcache_sasl_enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.password = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.proxies = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.redis_db = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.redis_server = localhost:6379 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.retry_attempts = 2 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.retry_delay = 0.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.socket_keepalive_count = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.socket_keepalive_idle = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.socket_keepalive_interval = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.socket_timeout = 1.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.tls_allowed_ciphers = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.tls_cafile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.tls_certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.tls_enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.tls_keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cache.username = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] coordination.backend_url = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.asyncio_connection = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.asyncio_slave_connection = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.backend = sqlalchemy {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.connection = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.connection_debug = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.connection_parameters = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.connection_recycle_time = 3600 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.connection_trace = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.db_inc_retry_interval = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.db_max_retries = 20 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86706) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.db_max_retry_interval = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.db_retry_interval = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 12:05:33 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.max_overflow = 50 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.max_pool_size = 5 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.max_retries = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.mysql_wsrep_sync_wait = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.pool_timeout = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.retry_interval = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.slave_connection = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.sqlite_synchronous = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.synchronous_reader = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] database.use_db_reconnect = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Running cmd (subprocess): mount.quobyte {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.connection_string = messaging:// {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.es_doc_type = notification {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.es_scroll_size = 10000 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.es_scroll_time = 2m {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.filter_error_trace = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.hmac_keys = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.sentinel_service_name = mymaster {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.socket_timeout = 0.1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.trace_requests = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler.trace_sqlalchemy = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler_jaeger.process_tags = {} {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler_jaeger.service_name_prefix = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] profiler_otlp.service_name_prefix = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.enforce_new_defaults = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.enforce_scope = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.policy_default_rule = default {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.policy_file = policy.yaml {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:33 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] privsep_osbrick.group = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] privsep_osbrick.helper_command = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] privsep_osbrick.user = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_sys_admin.group = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_sys_admin.helper_command = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] cinder_sys_admin.user = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.auth_section = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.auth_type = password {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.cafile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.collect_timing = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.insecure = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.send_service_user_token = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.split_loggers = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] service_user.timeout = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.auth_section = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.auth_type = password {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.collect_timing = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.insecure = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.region_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.split_loggers = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] glance.timeout = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.backend_availability_zone = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.chap_password = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.chap_username = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.disk_geometry = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.driver_client_cert = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.driver_client_cert_key = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.driver_data_namespace = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.driver_use_ssl = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.extra_capabilities = {} {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.filter_function = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.goodness_function = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.iscsi_target_flags = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.iscsi_write_cache = on {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.iser_helper = tgtadm {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.iser_port = 3260 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_host = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_login = admin {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_mount_options = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_password = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_private_key = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_share_path = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.num_shell_tries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.quobyte_volume_url = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.replication_device = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.report_discard_supported = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.reserved_percentage = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.target_helper = tgtadm {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.target_port = 3260 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.target_protocol = iscsi {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.trace_flags = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.unique_fqdn_network = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.use_chap_auth = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] CMD "mount.quobyte" returned: 1 in 0.141s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_backend_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_clear = zero {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_clear_ionice = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_clear_size = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_reports.file_event_handler = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_reports.log_dir = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.backend_availability_zone = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.backend_host = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.chap_password = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.chap_username = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.chiscsi_conf = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.disk_geometry = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.driver_client_cert = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.driver_data_namespace = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.driver_use_ssl = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.extra_capabilities = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.filter_function = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.goodness_function = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.iser_helper = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.iser_ip_address = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.iser_port = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.iser_target_prefix = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_host = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_login = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_mount_options = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_password = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_private_key = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_share_path = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_ssh_port = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.num_shell_tries = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.nvmet_port_id = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.replication_device = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.report_discard_supported = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.reserved_percentage = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.scst_target_driver = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.storage_protocol = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.target_helper = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.target_ip_address = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.target_port = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.target_prefix = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.target_protocol = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.trace_flags = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.use_chap_auth = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_clear = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_clear_size = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] QuobyteHD.volumes_dir = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.ssl = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_notifications.driver = [] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_notifications.retry = -1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] key_manager.fixed_key = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.barbican_api_version = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.barbican_endpoint = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.barbican_endpoint_type = public {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.barbican_region_name = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.cafile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.collect_timing = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.insecure = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.number_of_retries = 60 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.retry_delay = 1 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.send_service_user_token = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.split_loggers = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.timeout = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.verify_ssl = True {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican.verify_ssl_path = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.auth_section = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.auth_type = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.cafile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.certfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.collect_timing = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.insecure = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.keyfile = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.split_loggers = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] barbican_service_user.timeout = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.approle_role_id = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.approle_secret_id = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.kv_mountpoint = secret {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.kv_path = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.kv_version = 2 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.namespace = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.root_token_id = **** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.ssl_ca_crt_file = None {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.timeout = 60.0 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.use_ssl = False {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:05:34 devstack cinder-volume[86386]: DEBUG oslo_service.backend._eventlet.service [None req-8444a4ef-df34-4a36-b5f2-6f977a8dbf6e None None] ******************************************************************************** {{(pid=86386) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:05:35 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.190s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:35 devstack cinder-volume[86706]: INFO cinder.volume.driver [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG cinder.volume.driver [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86706) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG oslo_db.sqlalchemy.engines [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86706) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writer thread running {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG cinder.db.api [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Building query based on filter {{(pid=86706) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86706) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:35 devstack cinder-volume[86706]: INFO cinder.keymgr.migration [None req-0f6208f8-ec69-48f9-8f6f-99e2bdf036ac None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:05:35 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:05:35 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:36 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.654s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Driver initialization completed successfully. Jul 06 12:05:36 devstack cinder-volume[86706]: INFO cinder.manager [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Initiating service 3 cleanup Jul 06 12:05:36 devstack cinder-volume[86706]: INFO cinder.manager [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Service 3 cleanup completed. Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG cinder.service [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Creating RPC server for service cinder-volume {{(pid=86706) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG cinder.service [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86706) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:05:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:36 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:05:36 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:36 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.698s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-83b8dba8-07b5-46ab-9528-0d710056d3fa None None] Driver post RPC initialization completed successfully. Jul 06 12:05:43 devstack cinder-volume[86386]: DEBUG dbcounter [-] [86386] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86386) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:05:46 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:05:46 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=2 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:06:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:06:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 6 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:06:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Flow 'volume_create_manager' (0ec73862-872c-4605-aa7c-eae147755d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7f057a-174f-4862-8cf4-2ba99a6806c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7f057a-174f-4862-8cf4-2ba99a6806c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1355542023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab52e3da-31d4-441d-80fb-5d69e83a05dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a54715bfb154e97b6ba0df531ee174b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:36Z,use_quota=True,user_id='ec48b9e33a464f36999fa81f8c6e68ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b1e703-fe13-4ebd-9ab0-61320ffde8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b1e703-fe13-4ebd-9ab0-61320ffde8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f73a8a1-9734-4399-a144-2b2fec38d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Flow 'volume_create_manager' (0e028bd8-452b-4c07-a3ce-5af0f971f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51c0d9b-9ae6-4b4e-9460-2f05021ed97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51c0d9b-9ae6-4b4e-9460-2f05021ed97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1067566569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d546659-56c1-4fcb-9817-af6e4c9f1bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3df6f105df426c9dc6ddae0b7b88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:36Z,use_quota=True,user_id='482f57ce7ee04fdcac7b494bcd4f4b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d66464-b239-4016-b2ed-bdd9af1b4f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d66464-b239-4016-b2ed-bdd9af1b4f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b334b0-31de-44a1-9ff8-01fed67775fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b334b0-31de-44a1-9ff8-01fed67775fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d546659-56c1-4fcb-9817-af6e4c9f1bf5', 'volume_name': 'volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd7d055-37a9-47b0-8e4c-eebac35e7b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd7d055-37a9-47b0-8e4c-eebac35e7b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f544bb4-29bf-4bc2-9ab2-5e1df4ad8a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Volume 3d546659-56c1-4fcb-9817-af6e4c9f1bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5', 'volume_size': 1} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1067566569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d546659-56c1-4fcb-9817-af6e4c9f1bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3df6f105df426c9dc6ddae0b7b88d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:36Z,use_quota=True,user_id='482f57ce7ee04fdcac7b494bcd4f4b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Creating volume 3d546659-56c1-4fcb-9817-af6e4c9f1bf5 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:06:36 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:06:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:36 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 1073741824 Jul 06 12:06:36 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f73a8a1-9734-4399-a144-2b2fec38d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab52e3da-31d4-441d-80fb-5d69e83a05dc', 'volume_name': 'volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9a4a71-0546-412a-a547-37b2ce03b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9a4a71-0546-412a-a547-37b2ce03b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef46b0-1335-4511-a953-1bd88a1cf172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:37 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Volume ab52e3da-31d4-441d-80fb-5d69e83a05dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:06:37 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Trying to clone ab52e3da-31d4-441d-80fb-5d69e83a05dc from image b501de2b-75f2-48fc-a750-711c22cfabf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:06:37 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 1073741824" returned: 0 in 1.321s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:38 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 Jul 06 12:06:38 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:39 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5" returned: 0 in 1.508s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] <== create_volume: return (2906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:06:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.909s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f544bb4-29bf-4bc2-9ab2-5e1df4ad8a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41fd7c5-0798-4807-ac44-47c398431b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:39 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Volume volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 (3d546659-56c1-4fcb-9817-af6e4c9f1bf5): created successfully Jul 06 12:06:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41fd7c5-0798-4807-ac44-47c398431b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Flow 'volume_create_manager' (0e028bd8-452b-4c07-a3ce-5af0f971f86a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:06:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7b5f4c02-17ca-494d-bae6-e982eb3c4d63 tempest-TaggedAttachmentsTest-1091453351 None] Created volume successfully. Jul 06 12:06:42 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD, size 20.69 MB, duration 4.91 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:06:42 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Image download 20.69 MB at 4.21 MB/s Jul 06 12:06:42 devstack cinder-volume[86706]: INFO oslo.privsep.daemon [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpugncw6ww/privsep.sock'] Jul 06 12:06:42 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpugncw6ww/privsep.sock Jul 06 12:06:42 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:06:42 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:06:43 devstack cinder-volume[86706]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 12:06:44 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:44 devstack cinder-volume[86706]: INFO oslo.privsep.daemon [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Spawned new privsep daemon via rootwrap Jul 06 12:06:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Accepted privsep connection to /tmp/tmpugncw6ww/privsep.sock {{(pid=86706) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 12:06:44 devstack cinder-volume[86706]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 12:06:44 devstack cinder-volume[86706]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 12:06:44 devstack cinder-volume[86706]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 12:06:44 devstack cinder-volume[86706]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87232 Jul 06 12:06:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b66da2-5692-4a48-a9d4-d9a8e3f5c812]: (2,) {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:06:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f1b9d-66f3-41aa-b338-2a8fc3fd1963]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:06:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:44 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD Jul 06 12:06:44 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:45 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD" returned: 0 in 1.093s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:45 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 is fetched for user ec48b9e33a464f36999fa81f8c6e68ee. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:06:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ed104c-c5cd-478c-b667-7ed1ab546484]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:06:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:45 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD Jul 06 12:06:45 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:46 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD" returned: 0 in 1.438s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1355542023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab52e3da-31d4-441d-80fb-5d69e83a05dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a54715bfb154e97b6ba0df531ee174b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:06:36Z,use_quota=True,user_id='ec48b9e33a464f36999fa81f8c6e68ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Creating volume ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:06:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:06:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:06:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:06:47 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:06:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:47 devstack sudo[87268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc 1073741824 Jul 06 12:06:47 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:48 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc 1073741824" returned: 0 in 1.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:48 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc Jul 06 12:06:48 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:50 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc" returned: 0 in 1.242s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] <== create_volume: return (3110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:06:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.117s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:06:50 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Attempting download of b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume ab52e3da-31d4-441d-80fb-5d69e83a05dc. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:06:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7e3115-2968-47c1-942a-6f419ce39d77]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:06:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_gbl93vps {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:50 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_gbl93vps Jul 06 12:06:50 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:51 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_gbl93vps" returned: 0 in 0.893s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_gbl93vps {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:51 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_gbl93vps Jul 06 12:06:51 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:52 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_gbl93vps" returned: 1 in 0.915s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_gbl93vps' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:06:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[13031b1a-34db-49ca-b7bb-08ff787b606b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:06:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:52 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD Jul 06 12:06:52 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:53 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD" returned: 0 in 1.130s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:53 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] b501de2b-75f2-48fc-a750-711c22cfabf3 was qcow2, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:06:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:53 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc Jul 06 12:06:53 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:55 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc" returned: 0 in 2.504s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:55 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_vrn9v0mhdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:06:55 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Converted 112.00 MB image at 44.71 MB/s Jul 06 12:06:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:55 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc 1G Jul 06 12:06:55 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:56 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc 1G" returned: 0 in 1.041s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aabead-dd29-4fe8-a82e-b324def8a142]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:06:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:56 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc Jul 06 12:06:56 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:57 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc" returned: 0 in 1.178s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:58 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc Jul 06 12:06:58 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:59 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc" returned: 1 in 1.495s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Downloaded image b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume ab52e3da-31d4-441d-80fb-5d69e83a05dc successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 for user ec48b9e33a464f36999fa81f8c6e68ee is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Marking volume ab52e3da-31d4-441d-80fb-5d69e83a05dc as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Copying metadata from image b501de2b-75f2-48fc-a750-711c22cfabf3 to ab52e3da-31d4-441d-80fb-5d69e83a05dc. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Creating volume glance metadata for volume ab52e3da-31d4-441d-80fb-5d69e83a05dc backed by image b501de2b-75f2-48fc-a750-711c22cfabf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ef46b0-1335-4511-a953-1bd88a1cf172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3756552-dee6-4d1d-a5b7-40bdb7d89902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:06:59 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Volume volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc (ab52e3da-31d4-441d-80fb-5d69e83a05dc): created successfully Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3756552-dee6-4d1d-a5b7-40bdb7d89902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:06:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Flow 'volume_create_manager' (0ec73862-872c-4605-aa7c-eae147755d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:06:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6a93264b-7dbe-4c08-be39-309804e98e63 tempest-VolumesImageMetadata-1774032982 None] Created volume successfully. Jul 06 12:07:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Acquiring lock "cinder-ab52e3da-31d4-441d-80fb-5d69e83a05dc-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Lock "cinder-ab52e3da-31d4-441d-80fb-5d69e83a05dc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Acquiring lock "cinder-quobyte-ab52e3da-31d4-441d-80fb-5d69e83a05dc" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Lock "cinder-quobyte-ab52e3da-31d4-441d-80fb-5d69e83a05dc" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e4078-1bd2-405f-8c30-df2a544fec9f]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:02 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc Jul 06 12:07:02 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:03 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc" returned: 0 in 1.258s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:03 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc Jul 06 12:07:03 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:04 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc" returned: 1 in 1.609s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:07:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:04 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc Jul 06 12:07:04 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:06 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ab52e3da-31d4-441d-80fb-5d69e83a05dc" returned: 0 in 2.091s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Lock "cinder-quobyte-ab52e3da-31d4-441d-80fb-5d69e83a05dc" released by "delete_volume" :: held 5.069s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:07 devstack cinder-volume[86706]: WARNING cinder.quota [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:07:07 devstack cinder-volume[86706]: WARNING cinder.quota [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Flow 'volume_create_manager' (fb981d01-8179-41ad-ab91-e51bd63d15e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43843b85-de22-49bf-b5fc-4a48de84ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43843b85-de22-49bf-b5fc-4a48de84ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1897038955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33a2648d4bb4e40927421f46382f8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:07Z,use_quota=True,user_id='fb4a5f12b6c1407b8aca0c907d2543da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3db0400-d4b5-431e-8ec8-f9362773809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3db0400-d4b5-431e-8ec8-f9362773809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae7984a-e9eb-4b14-9e41-5cce9818c477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae7984a-e9eb-4b14-9e41-5cce9818c477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb', 'volume_name': 'volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708958a0-1588-4ea5-95f5-17dcbdf7eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708958a0-1588-4ea5-95f5-17dcbdf7eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c80202a-cb62-4793-bb1c-916fdf59e167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:07 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Volume c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb', 'volume_size': 1} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1897038955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33a2648d4bb4e40927421f46382f8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:07Z,use_quota=True,user_id='fb4a5f12b6c1407b8aca0c907d2543da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Creating volume c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:07:07 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Created reservations ['4da3cd20-636f-451a-9c3b-652f2ed99c3c', '98d17547-33c6-482c-be0c-35de9073d651', '6f56ab38-c137-4c65-803f-7624024f8727', '58c5abce-7000-4b68-9ca1-3a16d38052e4'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:07 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb 1073741824 Jul 06 12:07:07 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:08 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:07:08 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:10 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.987s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:10 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:10 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Deleted volume successfully. Jul 06 12:07:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2b2eaed8-d675-4121-aa11-668cf7ca57ca tempest-VolumesImageMetadata-1774032982 None] Lock "cinder-ab52e3da-31d4-441d-80fb-5d69e83a05dc-delete_volume" released by "delete_volume" :: held 8.647s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:10 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb 1073741824" returned: 0 in 2.990s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:11 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb Jul 06 12:07:11 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:12 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb" returned: 0 in 1.769s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] <== create_volume: return (4887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.898s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c80202a-cb62-4793-bb1c-916fdf59e167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c0dfe7-82fe-4889-b2ad-8da33fd56483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:12 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Volume volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb (c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb): created successfully Jul 06 12:07:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c0dfe7-82fe-4889-b2ad-8da33fd56483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Flow 'volume_create_manager' (fb981d01-8179-41ad-ab91-e51bd63d15e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-af7651f7-8274-452a-b1b5-6b2cbb769170 tempest-VolumesAdminNegativeTest-1901025247 None] Created volume successfully. Jul 06 12:07:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Acquiring lock "cinder-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Lock "cinder-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Acquiring lock "cinder-quobyte-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Lock "cinder-quobyte-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb" acquired by "delete_volume" :: waited 0.043s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:15 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fda8f76-a710-498d-b3e3-fc22df30acb1]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:15 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb Jul 06 12:07:15 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:16 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb" returned: 0 in 1.036s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:16 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb Jul 06 12:07:16 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:18 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb" returned: 0 in 1.421s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Lock "cinder-quobyte-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb" released by "delete_volume" :: held 2.546s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Created reservations ['2df2f139-4344-4eca-898f-51adce44e4fc', 'd3398470-004f-4389-8183-9768ce192c66', '72a0ba18-61d6-4ef8-b863-3bf0c8f1089e', '2330bbc8-5373-45c8-82cf-9dd12888a76b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:18 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:07:18 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Flow 'volume_create_manager' (bc61e9f2-3ac9-4baa-9951-aa41867bf1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a25a15-06db-4423-927c-38c54f06392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a25a15-06db-4423-927c-38c54f06392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1254000291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9730e5-bdef-47ce-868e-76fbb872ce43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef144f35a3fd4125a7a66fb0b4f9d088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:20Z,use_quota=True,user_id='a48e91bd65be42d39b435c9a48058042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075ca85a-94a0-4cb2-ae10-c8d471c65778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075ca85a-94a0-4cb2-ae10-c8d471c65778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c9d1c0-c539-440f-8c4b-f580763bf336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c9d1c0-c539-440f-8c4b-f580763bf336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9730e5-bdef-47ce-868e-76fbb872ce43', 'volume_name': 'volume-de9730e5-bdef-47ce-868e-76fbb872ce43', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031135b8-22f0-4f24-adfe-e8e8a5b2a009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031135b8-22f0-4f24-adfe-e8e8a5b2a009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60009476-d9b3-4c70-abd1-5bc360a3d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:19 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Volume de9730e5-bdef-47ce-868e-76fbb872ce43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9730e5-bdef-47ce-868e-76fbb872ce43', 'volume_size': 1} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1254000291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9730e5-bdef-47ce-868e-76fbb872ce43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef144f35a3fd4125a7a66fb0b4f9d088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:20Z,use_quota=True,user_id='a48e91bd65be42d39b435c9a48058042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Creating volume de9730e5-bdef-47ce-868e-76fbb872ce43 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:07:19 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:19 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 1073741824 Jul 06 12:07:19 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:19 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.402s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:19 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Deleted volume successfully. Jul 06 12:07:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6f887e08-df9b-4a54-892c-b708e43c352b tempest-VolumesAdminNegativeTest-1901025247 None] Lock "cinder-c24d8fec-7f2a-4a7a-a2b5-8b26cd1827eb-delete_volume" released by "delete_volume" :: held 4.482s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:20 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 1073741824" returned: 0 in 1.264s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:21 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 Jul 06 12:07:21 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:22 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43" returned: 0 in 1.179s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] <== create_volume: return (2503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.510s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60009476-d9b3-4c70-abd1-5bc360a3d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9730e5-bdef-47ce-868e-76fbb872ce43', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f088fc-c1c1-43cb-935f-5cf8e76ac753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:22 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Volume volume-de9730e5-bdef-47ce-868e-76fbb872ce43 (de9730e5-bdef-47ce-868e-76fbb872ce43): created successfully Jul 06 12:07:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f088fc-c1c1-43cb-935f-5cf8e76ac753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Flow 'volume_create_manager' (bc61e9f2-3ac9-4baa-9951-aa41867bf1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5815743a-f72d-436c-9739-9191160676f9 tempest-AbsoluteLimitsTests-297246956 None] Created volume successfully. Jul 06 12:07:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Acquiring lock "cinder-de9730e5-bdef-47ce-868e-76fbb872ce43-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Lock "cinder-de9730e5-bdef-47ce-868e-76fbb872ce43-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Acquiring lock "cinder-quobyte-de9730e5-bdef-47ce-868e-76fbb872ce43" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Lock "cinder-quobyte-de9730e5-bdef-47ce-868e-76fbb872ce43" acquired by "delete_volume" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:23 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f34d88-8271-4ec4-85b7-5e12a306869a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:23 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 Jul 06 12:07:23 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:24 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43" returned: 0 in 0.903s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:24 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43 Jul 06 12:07:24 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:24 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-de9730e5-bdef-47ce-868e-76fbb872ce43" returned: 0 in 0.697s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Lock "cinder-quobyte-de9730e5-bdef-47ce-868e-76fbb872ce43" released by "delete_volume" :: held 1.660s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Created reservations ['723b1b6c-b5a2-4c0c-aa0d-3d09fab33fd6', '20a371cd-6d07-4601-900d-4801f298c75b', 'b5e13842-f6e6-472b-a98d-7f3350f60e37', '7ef5cdff-e7ab-4ca3-8fcf-9f3a1d0e8ef2'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:25 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:07:25 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:25 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.788s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:25 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Deleted volume successfully. Jul 06 12:07:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c73a6b8d-831b-4c4b-894c-c24d8eb6a2e3 tempest-AbsoluteLimitsTests-297246956 None] Lock "cinder-de9730e5-bdef-47ce-868e-76fbb872ce43-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:07:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:27 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:07:27 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:27 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.017s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:07:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:07:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=31,cinder:UPDATE=46,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=30,cinder:SELECT=31,cinder:DELETE=4,cinder:INSERT=15 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Flow 'volume_create_manager' (cf3af2cb-8e65-4684-af25-2716b712e2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4aac35-da18-4457-8ffb-5cdfe0ef97bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4aac35-da18-4457-8ffb-5cdfe0ef97bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1183336916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d3574f-2e11-4e8e-84cc-b8929ab2a65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f488dd6fe144c08847ccaee230d72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:33Z,use_quota=True,user_id='f6ce11cbf5ef416f9f824f2075786518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a4fdc-7006-429d-a2ad-d10b4c85f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a4fdc-7006-429d-a2ad-d10b4c85f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac29c59-8019-4648-beec-65ec1876ce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac29c59-8019-4648-beec-65ec1876ce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d3574f-2e11-4e8e-84cc-b8929ab2a65e', 'volume_name': 'volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe1fe5d-81fc-4ca8-ba3e-ab382a55fa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe1fe5d-81fc-4ca8-ba3e-ab382a55fa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b836a0a-cc23-418c-9e3b-65520c95471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Volume 74d3574f-2e11-4e8e-84cc-b8929ab2a65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e', 'volume_size': 1} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1183336916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d3574f-2e11-4e8e-84cc-b8929ab2a65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f488dd6fe144c08847ccaee230d72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:33Z,use_quota=True,user_id='f6ce11cbf5ef416f9f824f2075786518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Creating volume 74d3574f-2e11-4e8e-84cc-b8929ab2a65e {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:07:33 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:07:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:33 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e 1073741824 Jul 06 12:07:33 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:34 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e 1073741824" returned: 0 in 1.184s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:34 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e Jul 06 12:07:34 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:35 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e" returned: 0 in 0.938s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b836a0a-cc23-418c-9e3b-65520c95471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc3d472-51f0-445c-8d97-b0f33a7eb753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:35 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Volume volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e (74d3574f-2e11-4e8e-84cc-b8929ab2a65e): created successfully Jul 06 12:07:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc3d472-51f0-445c-8d97-b0f33a7eb753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Flow 'volume_create_manager' (cf3af2cb-8e65-4684-af25-2716b712e2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:35 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9ec6d335-320c-494b-8d28-98e53505555e tempest-VolumesTransfersTest-1890330737 None] Created volume successfully. Jul 06 12:07:38 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a6e877bb-e8f8-492d-b116-1d6de440e091 tempest-VolumesTransfersTest-206158748 None] Transfer volume completed successfully. Jul 06 12:07:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Acquiring lock "cinder-74d3574f-2e11-4e8e-84cc-b8929ab2a65e-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-74d3574f-2e11-4e8e-84cc-b8929ab2a65e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Acquiring lock "cinder-quobyte-74d3574f-2e11-4e8e-84cc-b8929ab2a65e" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-quobyte-74d3574f-2e11-4e8e-84cc-b8929ab2a65e" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5ed8a-b822-4640-8cea-3ae728bd29cc]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:39 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e Jul 06 12:07:39 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:40 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e" returned: 0 in 1.296s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:40 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e Jul 06 12:07:40 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:41 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74d3574f-2e11-4e8e-84cc-b8929ab2a65e" returned: 0 in 0.917s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-quobyte-74d3574f-2e11-4e8e-84cc-b8929ab2a65e" released by "delete_volume" :: held 2.298s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:41 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Created reservations ['3cc4391e-62fa-4657-bd19-a1eb2ad9d343', '4d87eb56-2458-4e76-a4a6-774d953c1604', 'da5b7cfa-5507-4479-9db4-ee3ac766135c', '4b6e5e94-728d-485e-8eed-0a3a9cc307c6'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:42 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:07:42 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:43 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.058s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:43 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Deleted volume successfully. Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73ec8fe4-7ca9-4885-a361-659e60edcaab tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-74d3574f-2e11-4e8e-84cc-b8929ab2a65e-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Flow 'volume_create_manager' (9bfea934-5570-4f7b-800b-2651a6f36b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d019ea9b-93f2-4d6c-b079-aac8ba41e312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d019ea9b-93f2-4d6c-b079-aac8ba41e312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1245048733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e284234-1bd1-4c53-b834-6146604a2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f488dd6fe144c08847ccaee230d72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:44Z,use_quota=True,user_id='f6ce11cbf5ef416f9f824f2075786518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1eb2422-2ca1-4e00-b1af-c45b62b85840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1eb2422-2ca1-4e00-b1af-c45b62b85840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4553a305-70aa-4e9d-9ffb-5bb6d0c0101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4553a305-70aa-4e9d-9ffb-5bb6d0c0101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e284234-1bd1-4c53-b834-6146604a2af9', 'volume_name': 'volume-3e284234-1bd1-4c53-b834-6146604a2af9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf22b84-1ca5-4fd4-94a6-f86b5e5535fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf22b84-1ca5-4fd4-94a6-f86b5e5535fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e022377-bc7f-4c39-bec8-c64d954888e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:43 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Volume 3e284234-1bd1-4c53-b834-6146604a2af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e284234-1bd1-4c53-b834-6146604a2af9', 'volume_size': 1} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1245048733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e284234-1bd1-4c53-b834-6146604a2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f488dd6fe144c08847ccaee230d72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:07:44Z,use_quota=True,user_id='f6ce11cbf5ef416f9f824f2075786518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Creating volume 3e284234-1bd1-4c53-b834-6146604a2af9 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:07:43 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:07:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:43 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 1073741824 Jul 06 12:07:43 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:44 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 1073741824" returned: 0 in 1.070s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:45 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 Jul 06 12:07:45 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:45 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9" returned: 0 in 0.961s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:07:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e022377-bc7f-4c39-bec8-c64d954888e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e284234-1bd1-4c53-b834-6146604a2af9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d595317d-0353-4503-aece-9adbced2ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:07:46 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Volume volume-3e284234-1bd1-4c53-b834-6146604a2af9 (3e284234-1bd1-4c53-b834-6146604a2af9): created successfully Jul 06 12:07:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d595317d-0353-4503-aece-9adbced2ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:07:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Flow 'volume_create_manager' (9bfea934-5570-4f7b-800b-2651a6f36b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:07:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-34d0c268-f90f-4a90-aa17-ae3757b8228f tempest-VolumesTransfersTest-1890330737 None] Created volume successfully. Jul 06 12:07:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Acquiring lock "cinder-3e284234-1bd1-4c53-b834-6146604a2af9-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-3e284234-1bd1-4c53-b834-6146604a2af9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Acquiring lock "cinder-quobyte-3e284234-1bd1-4c53-b834-6146604a2af9" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:07:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-quobyte-3e284234-1bd1-4c53-b834-6146604a2af9" acquired by "delete_volume" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:07:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[36780542-a2b5-47a6-8696-e917cbe929e2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:48 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 Jul 06 12:07:48 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:49 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9" returned: 0 in 1.194s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:49 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9 Jul 06 12:07:49 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:49 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e284234-1bd1-4c53-b834-6146604a2af9" returned: 0 in 0.725s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-quobyte-3e284234-1bd1-4c53-b834-6146604a2af9" released by "delete_volume" :: held 1.990s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Created reservations ['78166e0c-f091-4b33-9eb5-a135b76f311d', '115a59a3-b544-4ffd-8f9f-6f375d71ff79', '40822005-18a4-46a9-a4ef-a5c61631011d', '15a4e6a0-3a81-4034-8525-efc279a26056'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:50 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:07:50 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:50 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.855s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:50 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Deleted volume successfully. Jul 06 12:07:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5fc32202-76d0-421d-9f17-4123cf7538d6 tempest-VolumesTransfersTest-1229391225 None] Lock "cinder-3e284234-1bd1-4c53-b834-6146604a2af9-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:07:56 devstack cinder-volume[86706]: WARNING py.warnings [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 06 12:07:56 devstack cinder-volume[86706]: .first() Jul 06 12:07:56 devstack cinder-volume[86706]: Jul 06 12:07:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c5142-2b26-4b65-b80c-dd71b3477faf]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:07:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:57 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 Jul 06 12:07:57 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:58 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5" returned: 0 in 1.187s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.223s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4ad50ee-f4b8-483b-a2e0-67ea7f8054c7', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:07:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-92223762-c30b-477b-a259-b4b257c3070d req-5b03216a-7039-413a-b7bf-d1c6c61b7099 tempest-TaggedAttachmentsTest-1091453351 None] attachment_update completed successfully. Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Flow 'volume_create_manager' (0cb6b014-1f65-4c83-b0f9-702915a8ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c9de97-5334-49e0-8f42-42d7a9e15ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c9de97-5334-49e0-8f42-42d7a9e15ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2032569294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71844bb-1d12-4f33-95fe-e2af5eb89c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9f1e259e654801963139f2f8c74353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:02Z,use_quota=True,user_id='50b47fa600be47e7925d91675d942428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c58f5a6-4f18-4840-bcc3-6d52ec572a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c58f5a6-4f18-4840-bcc3-6d52ec572a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23ad9c6-a8f1-4ff2-ba1a-caba35eff7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23ad9c6-a8f1-4ff2-ba1a-caba35eff7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71844bb-1d12-4f33-95fe-e2af5eb89c25', 'volume_name': 'volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac49889-ee8d-485b-bf84-0861c7e43ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac49889-ee8d-485b-bf84-0861c7e43ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43ed45f-f6f0-4b18-879d-05cdf57da0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:01 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Volume e71844bb-1d12-4f33-95fe-e2af5eb89c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25', 'volume_size': 1} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2032569294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71844bb-1d12-4f33-95fe-e2af5eb89c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9f1e259e654801963139f2f8c74353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:02Z,use_quota=True,user_id='50b47fa600be47e7925d91675d942428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Creating volume e71844bb-1d12-4f33-95fe-e2af5eb89c25 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:01 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:08:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:01 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 1073741824 Jul 06 12:08:01 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:02 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 1073741824" returned: 0 in 1.088s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:02 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 Jul 06 12:08:02 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:03 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25" returned: 0 in 1.139s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43ed45f-f6f0-4b18-879d-05cdf57da0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b20cb72-2666-4bd2-be72-667daf8ff636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Volume volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 (e71844bb-1d12-4f33-95fe-e2af5eb89c25): created successfully Jul 06 12:08:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b20cb72-2666-4bd2-be72-667daf8ff636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Flow 'volume_create_manager' (0cb6b014-1f65-4c83-b0f9-702915a8ad56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:04 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-be926343-2a34-418c-a94f-d853cd75a7d7 tempest-AttachVolumeTestJSON-1098345016 None] Created volume successfully. Jul 06 12:08:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-39c6d40a-6db4-47c1-b578-df688a999885 req-399e4832-7a56-4864-92fc-1a3f433cc634 tempest-TaggedAttachmentsTest-1091453351 None] Terminate volume connection completed successfully. Jul 06 12:08:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-39c6d40a-6db4-47c1-b578-df688a999885 req-399e4832-7a56-4864-92fc-1a3f433cc634 tempest-TaggedAttachmentsTest-1091453351 None] Deleting attachment d4ad50ee-f4b8-483b-a2e0-67ea7f8054c7. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:08:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-38425178-7c91-4c1a-902c-7ada2c74f250 req-d92ab0a8-037d-4258-93e3-c53a8d8c37a1 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-38425178-7c91-4c1a-902c-7ada2c74f250 req-d92ab0a8-037d-4258-93e3-c53a8d8c37a1 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cb5951-be37-483b-8ee9-1541043d7b45]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:08:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-38425178-7c91-4c1a-902c-7ada2c74f250 req-d92ab0a8-037d-4258-93e3-c53a8d8c37a1 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:08 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 Jul 06 12:08:08 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:09 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-38425178-7c91-4c1a-902c-7ada2c74f250 req-d92ab0a8-037d-4258-93e3-c53a8d8c37a1 tempest-AttachVolumeTestJSON-1098345016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25" returned: 0 in 0.965s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-38425178-7c91-4c1a-902c-7ada2c74f250 req-d92ab0a8-037d-4258-93e3-c53a8d8c37a1 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-38425178-7c91-4c1a-902c-7ada2c74f250 req-d92ab0a8-037d-4258-93e3-c53a8d8c37a1 tempest-AttachVolumeTestJSON-1098345016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94a4f09a-701e-4a95-a95b-36226335c70f', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:08:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-38425178-7c91-4c1a-902c-7ada2c74f250 req-d92ab0a8-037d-4258-93e3-c53a8d8c37a1 tempest-AttachVolumeTestJSON-1098345016 None] attachment_update completed successfully. Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Flow 'volume_create_manager' (27c602df-a4aa-4cd1-bd5c-8cea5d68136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef9136f-8e63-45e1-9d1f-594e571ad65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef9136f-8e63-45e1-9d1f-594e571ad65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009289801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395e00da023a44eba62fa1b4e81d6a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:13Z,use_quota=True,user_id='fac98e5741a64e41b5b778d7d9a82cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95599a06-2dce-46a0-8dbe-e8abfaa2d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95599a06-2dce-46a0-8dbe-e8abfaa2d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70366e5d-d1d5-4b3e-bb97-cbd4b17fa96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70366e5d-d1d5-4b3e-bb97-cbd4b17fa96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a', 'volume_name': 'volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98281a3-9709-48cc-97e4-a8d0e951729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98281a3-9709-48cc-97e4-a8d0e951729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993c78da-92fc-47bc-b50b-d2efd28c65df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:13 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Volume 3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a', 'volume_size': 1} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009289801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395e00da023a44eba62fa1b4e81d6a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:13Z,use_quota=True,user_id='fac98e5741a64e41b5b778d7d9a82cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Creating volume 3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:13 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:08:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:13 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a 1073741824 Jul 06 12:08:13 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:14 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a 1073741824" returned: 0 in 1.198s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:14 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:08:14 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:15 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 0.880s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993c78da-92fc-47bc-b50b-d2efd28c65df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157eebc3-1bd1-40c6-8bf1-cdcdc9b7fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:15 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Volume volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a (3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a): created successfully Jul 06 12:08:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157eebc3-1bd1-40c6-8bf1-cdcdc9b7fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Flow 'volume_create_manager' (27c602df-a4aa-4cd1-bd5c-8cea5d68136c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:15 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-29d70bf5-7c76-44c2-9238-82246f0c1e2a tempest-VolumesActionsTest-1934621622 None] Created volume successfully. Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Flow 'volume_create_manager' (50434d76-2180-4cb6-b939-1f256778648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46681592-b7fc-4d7b-85b1-691fce589d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46681592-b7fc-4d7b-85b1-691fce589d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-960519180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f649024-07fb-4478-be4c-42e530229e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03afce8683a0496d9eff90e5ab1b7236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:25Z,use_quota=True,user_id='15d2c38065cf4d2ba0221c11f4faeced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38cb56f-40ad-432f-ab72-a78d43c8565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38cb56f-40ad-432f-ab72-a78d43c8565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21661c97-45d2-489f-91c9-718b112c9d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21661c97-45d2-489f-91c9-718b112c9d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f649024-07fb-4478-be4c-42e530229e2d', 'volume_name': 'volume-5f649024-07fb-4478-be4c-42e530229e2d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd9147-66fe-4f65-8a41-abe7c0aeae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd9147-66fe-4f65-8a41-abe7c0aeae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c670a7-c570-41ea-ba6f-3b51e69ba052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:25 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Volume 5f649024-07fb-4478-be4c-42e530229e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f649024-07fb-4478-be4c-42e530229e2d', 'volume_size': 1} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-960519180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f649024-07fb-4478-be4c-42e530229e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03afce8683a0496d9eff90e5ab1b7236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:25Z,use_quota=True,user_id='15d2c38065cf4d2ba0221c11f4faeced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Creating volume 5f649024-07fb-4478-be4c-42e530229e2d {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:25 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:08:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:25 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d 1073741824 Jul 06 12:08:25 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:08:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:26 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d 1073741824" returned: 0 in 1.681s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:27 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:08:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:27 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:27 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d Jul 06 12:08:27 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:28 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d" returned: 0 in 0.952s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] <== create_volume: return (2749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.752s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c670a7-c570-41ea-ba6f-3b51e69ba052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f649024-07fb-4478-be4c-42e530229e2d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c26b851-7119-489c-bb11-c6dc9b689cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:28 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Volume volume-5f649024-07fb-4478-be4c-42e530229e2d (5f649024-07fb-4478-be4c-42e530229e2d): created successfully Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c26b851-7119-489c-bb11-c6dc9b689cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Flow 'volume_create_manager' (50434d76-2180-4cb6-b939-1f256778648e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:28 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-dc76a588-bab9-4e70-89e9-4bc18823bb4c tempest-DeleteServersTestJSON-654741272 None] Created volume successfully. Jul 06 12:08:28 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.415s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:08:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:08:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Acquiring lock "cinder-3d546659-56c1-4fcb-9817-af6e4c9f1bf5-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Lock "cinder-3d546659-56c1-4fcb-9817-af6e4c9f1bf5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Acquiring lock "cinder-quobyte-3d546659-56c1-4fcb-9817-af6e4c9f1bf5" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Lock "cinder-quobyte-3d546659-56c1-4fcb-9817-af6e4c9f1bf5" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:30 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afb47a7-3d3d-4c1d-943b-67076b40a7a4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:08:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:30 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 Jul 06 12:08:30 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-35dcbaca-242e-4538-8539-b0cf2e16a4d0 req-5a684d95-b0df-4ae3-bff4-b06898b1f123 tempest-DeleteServersTestJSON-654741272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-35dcbaca-242e-4538-8539-b0cf2e16a4d0 req-5a684d95-b0df-4ae3-bff4-b06898b1f123 tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:32 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bfe941-9590-4619-b40b-763e8385f18c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:08:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-35dcbaca-242e-4538-8539-b0cf2e16a4d0 req-5a684d95-b0df-4ae3-bff4-b06898b1f123 tempest-DeleteServersTestJSON-654741272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:32 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5" returned: 0 in 2.078s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:32 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d Jul 06 12:08:32 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:32 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5 Jul 06 12:08:32 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:34 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-35dcbaca-242e-4538-8539-b0cf2e16a4d0 req-5a684d95-b0df-4ae3-bff4-b06898b1f123 tempest-DeleteServersTestJSON-654741272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d" returned: 0 in 2.002s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-35dcbaca-242e-4538-8539-b0cf2e16a4d0 req-5a684d95-b0df-4ae3-bff4-b06898b1f123 tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.043s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=37,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=32,cinder:SELECT=34,cinder:INSERT=4,cinder:DELETE=5 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:08:34 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-35dcbaca-242e-4538-8539-b0cf2e16a4d0 req-5a684d95-b0df-4ae3-bff4-b06898b1f123 tempest-DeleteServersTestJSON-654741272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-5f649024-07fb-4478-be4c-42e530229e2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '204cfd4a-5f37-4a4a-a402-bd2ac4d92ea8', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d546659-56c1-4fcb-9817-af6e4c9f1bf5" returned: 0 in 1.659s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Lock "cinder-quobyte-3d546659-56c1-4fcb-9817-af6e4c9f1bf5" released by "delete_volume" :: held 3.794s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-35dcbaca-242e-4538-8539-b0cf2e16a4d0 req-5a684d95-b0df-4ae3-bff4-b06898b1f123 tempest-DeleteServersTestJSON-654741272 None] attachment_update completed successfully. Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Created reservations ['9a8fb037-8905-4570-a41b-c2cca57c4c46', 'b5374034-3e1f-4e92-a7ce-2b4198c8f11e', 'c26d3764-4b35-4a24-ba05-90141d6d6d89', '42b7ce61-4482-476a-b35d-3f4c2bd1713a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:34 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:08:34 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:36 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.590s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:36 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Deleted volume successfully. Jul 06 12:08:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79548d70-4cd4-44ec-8e6a-f8cff2ac63db tempest-TaggedAttachmentsTest-1091453351 None] Lock "cinder-3d546659-56c1-4fcb-9817-af6e4c9f1bf5-delete_volume" released by "delete_volume" :: held 5.897s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad19018c-53a6-4c15-b255-18931f434fbf tempest-VolumesActionsTest-1934621622 None] Acquiring lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" by "attach_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad19018c-53a6-4c15-b255-18931f434fbf tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" acquired by "attach_volume" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ad19018c-53a6-4c15-b255-18931f434fbf tempest-VolumesActionsTest-1934621622 None] Attaching volume 3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a to instance f6463d23-94cc-4aa8-8061-1b48994502e5 at mountpoint /dev/vdb on host None. Jul 06 12:08:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ad19018c-53a6-4c15-b255-18931f434fbf tempest-VolumesActionsTest-1934621622 None] Attach volume completed successfully. Jul 06 12:08:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad19018c-53a6-4c15-b255-18931f434fbf tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" released by "attach_volume" :: held 0.377s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a10f115c-f6e9-45bb-a909-61b32f0c1052 tempest-VolumesActionsTest-1934621622 None] Acquiring lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-detach_volume" by "detach_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a10f115c-f6e9-45bb-a909-61b32f0c1052 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a10f115c-f6e9-45bb-a909-61b32f0c1052 tempest-VolumesActionsTest-1934621622 None] Detaching volume 3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a from instance f6463d23-94cc-4aa8-8061-1b48994502e5. Jul 06 12:08:38 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a10f115c-f6e9-45bb-a909-61b32f0c1052 tempest-VolumesActionsTest-1934621622 None] Detach volume completed successfully. Jul 06 12:08:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a10f115c-f6e9-45bb-a909-61b32f0c1052 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-detach_volume" released by "detach_volume" :: held 0.188s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-5e2d34bb-7f46-46e7-b1b5-f206110399b4 req-85bfaab4-2081-4489-ac03-31d5b90a8cec tempest-DeleteServersTestJSON-654741272 None] Terminate volume connection completed successfully. Jul 06 12:08:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-5e2d34bb-7f46-46e7-b1b5-f206110399b4 req-85bfaab4-2081-4489-ac03-31d5b90a8cec tempest-DeleteServersTestJSON-654741272 None] Deleting attachment 204cfd4a-5f37-4a4a-a402-bd2ac4d92ea8. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:08:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Acquiring lock "cinder-5f649024-07fb-4478-be4c-42e530229e2d-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Lock "cinder-5f649024-07fb-4478-be4c-42e530229e2d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Acquiring lock "cinder-quobyte-5f649024-07fb-4478-be4c-42e530229e2d" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Lock "cinder-quobyte-5f649024-07fb-4478-be4c-42e530229e2d" acquired by "delete_volume" :: waited 0.043s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad07422-74b5-4e2a-9936-2d5fccaa3594]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:08:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:48 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d Jul 06 12:08:48 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:49 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d" returned: 0 in 1.020s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:49 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d Jul 06 12:08:49 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:50 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f649024-07fb-4478-be4c-42e530229e2d" returned: 0 in 0.813s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Lock "cinder-quobyte-5f649024-07fb-4478-be4c-42e530229e2d" released by "delete_volume" :: held 1.901s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Created reservations ['a1f1eae9-3cee-4af3-aa6e-5ce94777d562', 'd8243a7d-f9c5-4f45-a8d7-769080b15769', 'e2b3a66e-5096-40b9-ad85-bfd14377c572', 'cc32beea-8255-4d83-b0a1-e5c339dfec23'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:50 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:08:50 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:51 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.793s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:51 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Deleted volume successfully. Jul 06 12:08:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f18229-65b3-4c64-b790-8436889c39ac tempest-DeleteServersTestJSON-654741272 None] Lock "cinder-5f649024-07fb-4478-be4c-42e530229e2d-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Flow 'volume_create_manager' (27f74b9a-10da-4453-80df-20996468b036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89673a9-69ea-4f44-a161-6777c1bb0bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89673a9-69ea-4f44-a161-6777c1bb0bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1407740088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88a380a-6b0c-4d8e-a2b5-9c9d38b86085,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5dc7c5f79c1149d797689fd92304f921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:53Z,use_quota=True,user_id='d4c315ead67b44588a62e00fa321ee1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dabf0db-be61-4f48-b444-9e716403d1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dabf0db-be61-4f48-b444-9e716403d1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09761ff1-3a7a-425c-b3da-0be0d9a4636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09761ff1-3a7a-425c-b3da-0be0d9a4636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88a380a-6b0c-4d8e-a2b5-9c9d38b86085', 'volume_name': 'volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d0acd2-60d3-44e3-bf9b-6d7ef393054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d0acd2-60d3-44e3-bf9b-6d7ef393054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92849b5e-89d5-4b3d-892c-db18323cadd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:53 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Volume c88a380a-6b0c-4d8e-a2b5-9c9d38b86085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085', 'volume_size': 1} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1407740088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88a380a-6b0c-4d8e-a2b5-9c9d38b86085,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5dc7c5f79c1149d797689fd92304f921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:08:53Z,use_quota=True,user_id='d4c315ead67b44588a62e00fa321ee1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Creating volume c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:08:53 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:08:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:53 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 1073741824 Jul 06 12:08:53 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:54 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 1073741824" returned: 0 in 1.522s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:55 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 Jul 06 12:08:55 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:56 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085" returned: 0 in 1.073s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] <== create_volume: return (2695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:08:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92849b5e-89d5-4b3d-892c-db18323cadd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c9ae95-67c7-469d-8455-22b6d9ae7067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:08:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Volume volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 (c88a380a-6b0c-4d8e-a2b5-9c9d38b86085): created successfully Jul 06 12:08:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c9ae95-67c7-469d-8455-22b6d9ae7067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:08:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Flow 'volume_create_manager' (27f74b9a-10da-4453-80df-20996468b036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:08:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-06f7e03c-493e-48bb-9ca4-eaaee88ead22 req-2df93c01-1915-493e-9e63-9ca930df1290 tempest-VolumesGetTestJSON-1958450045 None] Created volume successfully. Jul 06 12:08:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Acquiring lock "cinder-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Lock "cinder-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Acquiring lock "cinder-quobyte-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:08:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Lock "cinder-quobyte-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:08:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3502b99f-a28e-4fa5-8fb2-0a32fa7560c3]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:08:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:57 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 Jul 06 12:08:57 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:58 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085" returned: 0 in 0.898s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:58 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085 Jul 06 12:08:58 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-bad35baa-931b-47db-a43e-3e3a19bda0b2 req-297332a6-a822-474f-be25-a566fdf4a46b tempest-AttachVolumeTestJSON-1098345016 None] Terminate volume connection completed successfully. Jul 06 12:08:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-bad35baa-931b-47db-a43e-3e3a19bda0b2 req-297332a6-a822-474f-be25-a566fdf4a46b tempest-AttachVolumeTestJSON-1098345016 None] Deleting attachment 94a4f09a-701e-4a95-a95b-36226335c70f. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:08:58 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085" returned: 0 in 0.793s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Lock "cinder-quobyte-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085" released by "delete_volume" :: held 1.756s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:08:59 devstack cinder-volume[86706]: DEBUG cinder.quota [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Created reservations ['cfe5901e-439e-4f6b-8e8b-1eff21fad31c', '79c55b8f-7117-4399-b8cd-47b2ca2c67a3', '3a54733a-a9b9-43ec-a803-61a876eff9ef', '75825fe3-dc91-4d7c-b172-f667b8870c28'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:08:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:59 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:08:59 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:00 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.194s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:00 devstack cinder-volume[86706]: DEBUG cinder.manager [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Deleted volume successfully. Jul 06 12:09:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-d732a6c6-d030-4105-9cd7-1a777bb0d14f req-ddbbc212-9d20-42fc-94f5-d42cb2c07884 tempest-VolumesGetTestJSON-1958450045 None] Lock "cinder-c88a380a-6b0c-4d8e-a2b5-9c9d38b86085-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Flow 'volume_create_manager' (11d85cf9-e7df-4c20-9a46-d91c64980832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df798af5-57d4-4f8e-9726-327f15bf9653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df798af5-57d4-4f8e-9726-327f15bf9653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1672371961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7b1ad2-079a-4468-a7e8-edb9426143d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b43538ee0feb475eb6ebfc32f53c71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:05Z,use_quota=True,user_id='863d0d30a93441dd9464ddf2ca1e580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418d6aa5-60bf-40f5-8d66-7bface254da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418d6aa5-60bf-40f5-8d66-7bface254da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d882501-72a6-48dd-89ce-f9364fe80837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d882501-72a6-48dd-89ce-f9364fe80837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7b1ad2-079a-4468-a7e8-edb9426143d6', 'volume_name': 'volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140fa59a-af50-4e49-96e8-037519f169a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140fa59a-af50-4e49-96e8-037519f169a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2a3eed-b809-4fc1-b1c1-d950b6bccccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Volume 8b7b1ad2-079a-4468-a7e8-edb9426143d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6', 'volume_size': 1} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1672371961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7b1ad2-079a-4468-a7e8-edb9426143d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b43538ee0feb475eb6ebfc32f53c71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:05Z,use_quota=True,user_id='863d0d30a93441dd9464ddf2ca1e580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Creating volume 8b7b1ad2-079a-4468-a7e8-edb9426143d6 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:05 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54d232a5-b023-46b9-a885-a2a03dac0c7c tempest-VolumesActionsTest-1934621622 None] Acquiring lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" by "attach_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:05 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 1073741824 Jul 06 12:09:05 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54d232a5-b023-46b9-a885-a2a03dac0c7c tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" acquired by "attach_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-54d232a5-b023-46b9-a885-a2a03dac0c7c tempest-VolumesActionsTest-1934621622 None] Attaching volume 3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a to instance 808f4d12-c919-4a0e-b995-3ef939cc02b0 at mountpoint /dev/vdb on host None. Jul 06 12:09:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-54d232a5-b023-46b9-a885-a2a03dac0c7c tempest-VolumesActionsTest-1934621622 None] Attach volume completed successfully. Jul 06 12:09:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54d232a5-b023-46b9-a885-a2a03dac0c7c tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" released by "attach_volume" :: held 0.192s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3bfb3d77-672d-4d2d-becc-e2e9ab6649d3 tempest-VolumesActionsTest-1934621622 None] Acquiring lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-detach_volume" by "detach_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3bfb3d77-672d-4d2d-becc-e2e9ab6649d3 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3bfb3d77-672d-4d2d-becc-e2e9ab6649d3 tempest-VolumesActionsTest-1934621622 None] Detaching volume 3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a from instance 808f4d12-c919-4a0e-b995-3ef939cc02b0. Jul 06 12:09:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3bfb3d77-672d-4d2d-becc-e2e9ab6649d3 tempest-VolumesActionsTest-1934621622 None] Detach volume completed successfully. Jul 06 12:09:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3bfb3d77-672d-4d2d-becc-e2e9ab6649d3 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:06 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 1073741824" returned: 0 in 1.603s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:07 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 Jul 06 12:09:07 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:07 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6" returned: 0 in 0.935s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] <== create_volume: return (2610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.617s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2a3eed-b809-4fc1-b1c1-d950b6bccccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cae6158-2b4f-4f45-bf3d-509591f3eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:08 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Volume volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 (8b7b1ad2-079a-4468-a7e8-edb9426143d6): created successfully Jul 06 12:09:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cae6158-2b4f-4f45-bf3d-509591f3eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Flow 'volume_create_manager' (11d85cf9-e7df-4c20-9a46-d91c64980832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-dd2aafb5-6ba7-4a88-8dfa-36c4886642ed tempest-VolumesTestJSON-1602907979 None] Created volume successfully. Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Flow 'volume_create_manager' (80b58101-7f03-4359-a8cb-510583cc864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d30504-db99-4fe0-aad3-62235fff9ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d30504-db99-4fe0-aad3-62235fff9ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-334640680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28597b08-48f2-41fa-be9c-aacfa08df543,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b43538ee0feb475eb6ebfc32f53c71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:09Z,use_quota=True,user_id='863d0d30a93441dd9464ddf2ca1e580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6690f83f-53f1-4a44-bef4-1dddf6fdd918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6690f83f-53f1-4a44-bef4-1dddf6fdd918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4963ded-9b6d-4ff2-8ba2-7d9ad0de007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4963ded-9b6d-4ff2-8ba2-7d9ad0de007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28597b08-48f2-41fa-be9c-aacfa08df543', 'volume_name': 'volume-28597b08-48f2-41fa-be9c-aacfa08df543', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0a595d-0d42-4b9b-bd9d-6c5b963c2234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0a595d-0d42-4b9b-bd9d-6c5b963c2234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7f655f-8da1-4e01-b45f-e441123f7c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Volume 28597b08-48f2-41fa-be9c-aacfa08df543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28597b08-48f2-41fa-be9c-aacfa08df543', 'volume_size': 1} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-334640680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28597b08-48f2-41fa-be9c-aacfa08df543,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b43538ee0feb475eb6ebfc32f53c71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:09Z,use_quota=True,user_id='863d0d30a93441dd9464ddf2ca1e580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Creating volume 28597b08-48f2-41fa-be9c-aacfa08df543 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:09 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:09:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:09 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 1073741824 Jul 06 12:09:09 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:10 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 1073741824" returned: 0 in 1.383s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:11 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 Jul 06 12:09:11 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:12 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543" returned: 0 in 1.071s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] <== create_volume: return (2535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7f655f-8da1-4e01-b45f-e441123f7c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28597b08-48f2-41fa-be9c-aacfa08df543', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56bb885-847d-4726-84f4-5e8de1ecd46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:12 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Volume volume-28597b08-48f2-41fa-be9c-aacfa08df543 (28597b08-48f2-41fa-be9c-aacfa08df543): created successfully Jul 06 12:09:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56bb885-847d-4726-84f4-5e8de1ecd46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Flow 'volume_create_manager' (80b58101-7f03-4359-a8cb-510583cc864f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6b73dbe3-140a-469e-8a81-ecb993cd901a tempest-VolumesTestJSON-1602907979 None] Created volume successfully. Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Flow 'volume_create_manager' (8e59d1a4-99af-4669-b741-4321a66e64b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c452bad-8007-42c9-8d0e-dec4f282cde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c452bad-8007-42c9-8d0e-dec4f282cde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-45349651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f923a416-8a5c-4c8a-b930-bf71d0b19443,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b43538ee0feb475eb6ebfc32f53c71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:14Z,use_quota=True,user_id='863d0d30a93441dd9464ddf2ca1e580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a4a849-caea-45de-901a-09a5fb2befcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a4a849-caea-45de-901a-09a5fb2befcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecea1fd-9784-4a4d-8c4a-f70a23606cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecea1fd-9784-4a4d-8c4a-f70a23606cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f923a416-8a5c-4c8a-b930-bf71d0b19443', 'volume_name': 'volume-f923a416-8a5c-4c8a-b930-bf71d0b19443', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69396c1d-073c-4838-af4d-991488ae5493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69396c1d-073c-4838-af4d-991488ae5493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298d1727-bbbf-4f54-bcba-8495c14def22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:14 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Volume f923a416-8a5c-4c8a-b930-bf71d0b19443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f923a416-8a5c-4c8a-b930-bf71d0b19443', 'volume_size': 1} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-45349651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f923a416-8a5c-4c8a-b930-bf71d0b19443,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b43538ee0feb475eb6ebfc32f53c71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:14Z,use_quota=True,user_id='863d0d30a93441dd9464ddf2ca1e580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Creating volume f923a416-8a5c-4c8a-b930-bf71d0b19443 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:14 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:09:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:14 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 1073741824 Jul 06 12:09:14 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:15 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 1073741824" returned: 0 in 1.665s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:16 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 Jul 06 12:09:16 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:17 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443" returned: 0 in 1.130s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] <== create_volume: return (2929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.931s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298d1727-bbbf-4f54-bcba-8495c14def22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f923a416-8a5c-4c8a-b930-bf71d0b19443', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddefcbf-67e2-428e-bac6-f98396f0c85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:17 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Volume volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 (f923a416-8a5c-4c8a-b930-bf71d0b19443): created successfully Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddefcbf-67e2-428e-bac6-f98396f0c85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Flow 'volume_create_manager' (8e59d1a4-99af-4669-b741-4321a66e64b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-725cbffb-50fd-4105-95b4-4dc35d69bc40 tempest-VolumesTestJSON-1602907979 None] Created volume successfully. Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[318efd23-7a3b-4863-8c57-672a280d5f68]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:18 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:09:18 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:18 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 0.970s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:18 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6a89c-f77b-41a9-9722-c926e3439ecf]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:19 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:09:19 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "cinder-f923a416-8a5c-4c8a-b930-bf71d0b19443-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-f923a416-8a5c-4c8a-b930-bf71d0b19443-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "cinder-quobyte-f923a416-8a5c-4c8a-b930-bf71d0b19443" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-quobyte-f923a416-8a5c-4c8a-b930-bf71d0b19443" acquired by "delete_volume" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:19 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5d3be7-8720-42ec-81a6-6e0055017b32]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:19 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 Jul 06 12:09:19 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:20 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 1.080s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.7e3ab9e5-3326-4074-a944-9f589fa9bc4an40svq1e.img {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:20 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.7e3ab9e5-3326-4074-a944-9f589fa9bc4an40svq1e.img Jul 06 12:09:20 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:20 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443" returned: 0 in 0.821s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:20 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443 Jul 06 12:09:20 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:22 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f923a416-8a5c-4c8a-b930-bf71d0b19443" returned: 0 in 2.096s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-quobyte-f923a416-8a5c-4c8a-b930-bf71d0b19443" released by "delete_volume" :: held 3.017s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:22 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Created reservations ['60efb21b-7d48-4d42-9249-caa2babb64dd', '39cf1f83-f2b4-4e3e-a66c-04f99181b891', 'b4cd637e-dbe1-4624-9f0a-258a5f1eeb1a', '31f2878d-70e5-48b8-ac5a-f2bea6bf8c5a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:23 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:09:23 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "cinder-28597b08-48f2-41fa-be9c-aacfa08df543-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-28597b08-48f2-41fa-be9c-aacfa08df543-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "cinder-quobyte-28597b08-48f2-41fa-be9c-aacfa08df543" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-quobyte-28597b08-48f2-41fa-be9c-aacfa08df543" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:24 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d092550-b40d-43d9-a4a8-316fdeaa4589]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:24 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 Jul 06 12:09:24 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:25 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 2.532s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:25 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:26 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Deleted volume successfully. Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f9c868d-73ca-444a-b87a-90927ba3e406 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-f923a416-8a5c-4c8a-b930-bf71d0b19443-delete_volume" released by "delete_volume" :: held 6.491s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:26 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543" returned: 0 in 2.378s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:26 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543 Jul 06 12:09:26 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:27 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:09:27 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:27 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.7e3ab9e5-3326-4074-a944-9f589fa9bc4an40svq1e.img" returned: 0 in 7.649s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:27 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-28597b08-48f2-41fa-be9c-aacfa08df543" returned: 0 in 1.243s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f79c8e-5fa0-4b76-8a80-2e599d110621]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-quobyte-28597b08-48f2-41fa-be9c-aacfa08df543" released by "delete_volume" :: held 3.773s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Created reservations ['a4a31c6a-b2f2-467f-9ad1-eab18baf79fd', 'e7634fd1-d1e7-41e0-b91b-2c8d12da1d53', '53b2b95b-2c1b-484b-9c9f-55347cb8b0e4', '035ee45f-9658-4625-8830-233d52146406'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:27 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:09:27 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:27 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:09:27 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:27 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.969s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:28 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.787s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:28 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Deleted volume successfully. Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-651cb3f9-a268-4f96-a31f-1eb3e89be7b5 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-28597b08-48f2-41fa-be9c-aacfa08df543-delete_volume" released by "delete_volume" :: held 4.887s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:28 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 1.036s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.7e3ab9e5-3326-4074-a944-9f589fa9bc4an40svq1e.img {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:09:28 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Converted 1024.00 MB image at 133.85 MB/s Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] 7e3ab9e5-3326-4074-a944-9f589fa9bc4a was raw, no need to convert to raw {{(pid=86706) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "cinder-8b7b1ad2-079a-4468-a7e8-edb9426143d6-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-8b7b1ad2-079a-4468-a7e8-edb9426143d6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "cinder-quobyte-8b7b1ad2-079a-4468-a7e8-edb9426143d6" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-quobyte-8b7b1ad2-079a-4468-a7e8-edb9426143d6" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[831f43fe-6596-432d-86ff-a1b3940469e2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:29 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 Jul 06 12:09:29 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:29 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6" returned: 0 in 1.013s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:29 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6 Jul 06 12:09:29 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:30 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8b7b1ad2-079a-4468-a7e8-edb9426143d6" returned: 0 in 0.892s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-quobyte-8b7b1ad2-079a-4468-a7e8-edb9426143d6" released by "delete_volume" :: held 1.964s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Created reservations ['27a98bbe-341f-4443-b9f7-46238de00db0', '4199461f-a80a-4189-a3c0-0d6b6088a962', 'f3bde498-e8dc-4a1e-98de-90b63c247e76', 'dd93f84e-3224-4854-a50a-e7d4596e3a8d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:31 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:09:31 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:31 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.774s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:31 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Deleted volume successfully. Jul 06 12:09:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-db48a4af-f8de-4e5b-997d-7e3be85d1071 tempest-VolumesTestJSON-1602907979 None] Lock "cinder-8b7b1ad2-079a-4468-a7e8-edb9426143d6-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:36 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=54,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:09:37 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=60,cinder:SELECT=61,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:09:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-92c6425a-5338-401f-9508-e9b5ab7d0770 tempest-GroupSnapshotsV319Test-663823611 None] Group tempest-GroupSnapshotsV319Test-Group-1887423163: creating Jul 06 12:09:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-92c6425a-5338-401f-9508-e9b5ab7d0770 tempest-GroupSnapshotsV319Test-663823611 None] Group tempest-GroupSnapshotsV319Test-Group-1887423163: created successfully Jul 06 12:09:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-92c6425a-5338-401f-9508-e9b5ab7d0770 tempest-GroupSnapshotsV319Test-663823611 None] Create group completed successfully. Jul 06 12:09:41 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Flow 'volume_create_manager' (c70900c8-97bf-4370-bc4a-36990510fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62239c72-4ba4-45bb-8335-1218669e2b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62239c72-4ba4-45bb-8335-1218669e2b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1571059282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=623bbce9-00ef-40f6-94d0-146345c76c91,host='devstack@QuobyteHD#QuobyteHD',id=3235fd6e-dca5-4b74-b107-3d90821e122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fc44f1ac6245dab46ca55ab5f02cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:42Z,use_quota=True,user_id='e74b8d460e4e494984191e9156b3fcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f37c6c48-d6c5-45da-b120-3e79091861f1),volume_type_id=f37c6c48-d6c5-45da-b120-3e79091861f1)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624e109d-ccc9-43f4-abaa-b7bd4cb5326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624e109d-ccc9-43f4-abaa-b7bd4cb5326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d70316-8035-484f-a0fd-1d693bc83e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d70316-8035-484f-a0fd-1d693bc83e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3235fd6e-dca5-4b74-b107-3d90821e122a', 'volume_name': 'volume-3235fd6e-dca5-4b74-b107-3d90821e122a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19fa7e2-950d-4de4-9e56-a58cf6f2fce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19fa7e2-950d-4de4-9e56-a58cf6f2fce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15924c39-0ee1-4e1b-a37a-88d6d5d74917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:42 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Volume 3235fd6e-dca5-4b74-b107-3d90821e122a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3235fd6e-dca5-4b74-b107-3d90821e122a', 'volume_size': 1} Jul 06 12:09:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:51 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:09:52 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.552s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Uploaded volume to glance image-id: 7e3ab9e5-3326-4074-a944-9f589fa9bc4a. {{(pid=86706) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.387s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=623bbce9-00ef-40f6-94d0-146345c76c91,created_at=2026-07-06T10:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1571059282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=623bbce9-00ef-40f6-94d0-146345c76c91,host='devstack@QuobyteHD#QuobyteHD',id=3235fd6e-dca5-4b74-b107-3d90821e122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18fc44f1ac6245dab46ca55ab5f02cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:42Z,use_quota=True,user_id='e74b8d460e4e494984191e9156b3fcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f37c6c48-d6c5-45da-b120-3e79091861f1),volume_type_id=f37c6c48-d6c5-45da-b120-3e79091861f1)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Creating volume 3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:56 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:09:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:56 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a 1073741824 Jul 06 12:09:56 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c9ad1262-9460-46f6-82df-3a27791d29b1 tempest-VolumesActionsTest-1934621622 None] Copy volume to image completed successfully. Jul 06 12:09:58 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a 1073741824" returned: 0 in 1.566s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:58 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a Jul 06 12:09:58 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:59 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a" returned: 0 in 1.174s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] <== create_volume: return (2837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.840s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15924c39-0ee1-4e1b-a37a-88d6d5d74917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3235fd6e-dca5-4b74-b107-3d90821e122a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75af970-59e3-459f-ac8c-4cbce974745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[811abbe4-fe80-474c-bbdc-1bd6574f6816]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:59 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Volume volume-3235fd6e-dca5-4b74-b107-3d90821e122a (3235fd6e-dca5-4b74-b107-3d90821e122a): created successfully Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75af970-59e3-459f-ac8c-4cbce974745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Flow 'volume_create_manager' (c70900c8-97bf-4370-bc4a-36990510fb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3baec763-8559-4e9e-a4b7-4e53870753c0 tempest-GroupSnapshotsV319Test-663823611 None] Created volume successfully. Jul 06 12:09:59 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:09:59 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:00 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 0.884s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da8202-dd6d-4798-bca7-6526e21b7d88]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:00 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:10:00 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] GroupSnapshot db0845a0-d494-49b6-8a3c-78581d7caae7: creating. Jul 06 12:10:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Group snapshot db0845a0-d494-49b6-8a3c-78581d7caae7: creating. {{(pid=86706) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:10:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:01 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 0.889s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:01 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img Jul 06 12:10:01 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Flow 'volume_create_manager' (30c90685-5619-453e-87ce-89eb2d3ad08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c8c17-1ae6-4784-a8c9-497c6119e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c8c17-1ae6-4784-a8c9-497c6119e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1711428457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d749d15b9c24d0ab7cea2de1db15af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:06Z,use_quota=True,user_id='7ed3f35c479f4727aaeed10ad0ecc197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eb4320-3a42-4b65-ab59-88a6889e0191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eb4320-3a42-4b65-ab59-88a6889e0191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4aac2df-c198-41d4-ba1a-3e31a95f3d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4aac2df-c198-41d4-ba1a-3e31a95f3d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d', 'volume_name': 'volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6285cfc3-01d6-45de-b256-a9742e7aca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6285cfc3-01d6-45de-b256-a9742e7aca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3c0c5-0baa-42a1-90ab-2a3c6c60899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Volume 9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d', 'volume_size': 1} Jul 06 12:10:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img" returned: 0 in 7.650s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4498679b-6ba3-4a18-8592-bc6b6dd4792b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:09 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:10:09 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:10 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 1.488s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:10 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:10:10 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Converted 1024.00 MB image at 133.84 MB/s Jul 06 12:10:10 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] 836ecfe0-e97f-406c-b6fe-0b1e3a4010dc was raw, converting to qcow2 {{(pid=86706) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 12:10:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[099a7104-b854-47d3-902a-0fa7b56c2f1c]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:10 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img Jul 06 12:10:10 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:11 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img" returned: 0 in 1.012s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:11 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img Jul 06 12:10:11 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:12 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img" returned: 1 in 0.974s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:10:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img /opt/stack/data/cinder/conversion/vol_upload_evzhw07l {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:12 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img /opt/stack/data/cinder/conversion/vol_upload_evzhw07l Jul 06 12:10:12 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:13 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img /opt/stack/data/cinder/conversion/vol_upload_evzhw07l" returned: 0 in 0.932s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:13 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Image conversion details: src /opt/stack/data/cinder/conversion/3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a.temp_image.836ecfe0-e97f-406c-b6fe-0b1e3a4010dco8spx21r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_evzhw07l {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:10:13 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 06 12:10:13 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e251175-e92e-456c-b851-91253449e01f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_evzhw07l {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:13 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_evzhw07l Jul 06 12:10:13 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:14 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_evzhw07l" returned: 0 in 0.771s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.225s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Uploaded volume to glance image-id: 836ecfe0-e97f-406c-b6fe-0b1e3a4010dc. {{(pid=86706) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 12:10:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.877s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Creating offline snapshot 3a49bc2e-f59b-486f-a904-66aaf24c4357 of volume 3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:10:15 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a4525664-5e89-43d1-8d44-7309d37ada10 tempest-VolumesActionsTest-1934621622 None] Copy volume to image completed successfully. Jul 06 12:10:15 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8374a7d2-ba00-4e80-8e65-0ef008cb7cc4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:15 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a Jul 06 12:10:15 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Acquiring lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Acquiring lock "cinder-quobyte-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-quobyte-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:16 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a" returned: 0 in 1.064s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c9a2ba-1fa3-4ea7-b6d5-fc0fd7db7cd8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:16 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 1G Jul 06 12:10:16 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:16 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:10:16 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:17 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 0.961s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:17 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a Jul 06 12:10:17 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:18 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 1G" returned: 0 in 1.444s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3235fd6e-dca5-4b74-b107-3d90821e122a -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:18 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3235fd6e-dca5-4b74-b107-3d90821e122a -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 Jul 06 12:10:18 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:18 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" returned: 0 in 0.998s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-quobyte-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a" released by "delete_volume" :: held 2.041s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Created reservations ['b3b4a776-6d55-463e-9d6e-13c15e2eaa51', 'f67dfc4f-f816-4ac7-af44-73ce995b1000', 'f6ee1dce-4244-448f-bdbd-7bd9ad2e02d6', '116e731d-4c5a-4805-9ce8-3f0f8c454604'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:18 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:10:18 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:19 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3235fd6e-dca5-4b74-b107-3d90821e122a -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357" returned: 0 in 1.343s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:19 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:10:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:19 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 Jul 06 12:10:19 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:20 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.178s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:20 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Deleted volume successfully. Jul 06 12:10:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6141ca4f-3204-416b-90b3-edbc80954562 tempest-VolumesActionsTest-1934621622 None] Lock "cinder-3e1f9ad7-e1e0-4eac-8a8f-2509bc1dc44a-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:20 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357" returned: 0 in 1.151s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:20 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.info Jul 06 12:10:20 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:21 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.info" returned: 0 in 0.789s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:21 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:10:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:21 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.info Jul 06 12:10:21 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:22 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.info" returned: 0 in 0.871s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.772s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.036s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1711428457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d749d15b9c24d0ab7cea2de1db15af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:06Z,use_quota=True,user_id='7ed3f35c479f4727aaeed10ad0ecc197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Creating volume 9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:22 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:10:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:22 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d 1073741824 Jul 06 12:10:22 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4dd9b82c-ae9e-4663-8428-ac5f72718781 tempest-GroupSnapshotsV319Test-663823611 None] group_snapshot db0845a0-d494-49b6-8a3c-78581d7caae7: created successfully Jul 06 12:10:23 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d 1073741824" returned: 0 in 1.090s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:23 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d Jul 06 12:10:23 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:24 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] group_snapshot db0845a0-d494-49b6-8a3c-78581d7caae7: deleting Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] group_snapshot db0845a0-d494-49b6-8a3c-78581d7caae7: deleting {{(pid=86706) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Acquiring lock "cinder-quobyte-3235fd6e-dca5-4b74-b107-3d90821e122a" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Lock "cinder-quobyte-3235fd6e-dca5-4b74-b107-3d90821e122a" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Acquiring lock "cinder-quobyte-3a49bc2e-f59b-486f-a904-66aaf24c4357" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Lock "cinder-quobyte-3a49bc2e-f59b-486f-a904-66aaf24c4357" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Deleting offline snapshot 3a49bc2e-f59b-486f-a904-66aaf24c4357 of volume 3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] snapshot_file for this snap is: volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:10:24 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" returned: 0 in 1.356s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] <== create_volume: return (2512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.516s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7190cf9-e537-4551-bf99-274cd76275ef]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3c0c5-0baa-42a1-90ab-2a3c6c60899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c65806-a701-4073-a73a-e3860d8d6ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:24 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Volume volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d (9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d): created successfully Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c65806-a701-4073-a73a-e3860d8d6ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Flow 'volume_create_manager' (30c90685-5619-453e-87ce-89eb2d3ad08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-58836dd0-c6ed-4c52-a99d-5db2b7cc2865 tempest-ServerActionsTestOtherA-402166127 None] Created volume successfully. Jul 06 12:10:25 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 Jul 06 12:10:25 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:26 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357" returned: 0 in 1.190s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3235fd6e-dca5-4b74-b107-3d90821e122a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bde530f-cc19-4301-b571-2853300f9a76]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:26 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a Jul 06 12:10:26 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:27 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:10:27 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:27 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a" returned: 0 in 1.490s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:27 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 Jul 06 12:10:27 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:28 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.122s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:10:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:10:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:10:29 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357" returned: 0 in 1.499s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:29 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357 Jul 06 12:10:29 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Flow 'volume_create_manager' (97569e69-62df-4426-9689-18861eb163e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e346cd75-af4b-430b-9663-85bf77e3c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e346cd75-af4b-430b-9663-85bf77e3c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-418228589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521e5c5f-ff7f-4abd-a388-ce067499e6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0c7f7621f341dab612e8a6c577bcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:29Z,use_quota=True,user_id='1d126693347948c286a6d286cf353ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42502d95-d4de-46c2-80a1-90a16909ae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42502d95-d4de-46c2-80a1-90a16909ae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90532ce-fc32-406a-93de-1d4b8a55e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90532ce-fc32-406a-93de-1d4b8a55e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521e5c5f-ff7f-4abd-a388-ce067499e6a6', 'volume_name': 'volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6', 'volume_size': 2}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8171cd43-27ee-4ec1-a1dc-3abd72e757ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8171cd43-27ee-4ec1-a1dc-3abd72e757ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370ad01e-28fe-4c17-aa7e-fc94de4820cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:29 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Volume 521e5c5f-ff7f-4abd-a388-ce067499e6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6', 'volume_size': 2} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-418228589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521e5c5f-ff7f-4abd-a388-ce067499e6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0c7f7621f341dab612e8a6c577bcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:29Z,use_quota=True,user_id='1d126693347948c286a6d286cf353ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Creating volume 521e5c5f-ff7f-4abd-a388-ce067499e6a6 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:29 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:10:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 2147483648 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:29 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 2147483648 Jul 06 12:10:29 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:30 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a.3a49bc2e-f59b-486f-a904-66aaf24c4357" returned: 0 in 1.034s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Lock "cinder-quobyte-3a49bc2e-f59b-486f-a904-66aaf24c4357" released by "_delete_snapshot" :: held 5.444s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Lock "cinder-quobyte-3235fd6e-dca5-4b74-b107-3d90821e122a" released by "delete_snapshot" :: held 5.475s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:30 devstack cinder-volume[86706]: WARNING cinder.quota [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1739732836 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1739732836, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:10:30 devstack cinder-volume[86706]: WARNING cinder.quota [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1739732836 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1739732836, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:10:30 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] Created reservations ['bb3fa4fb-5925-4e0a-976e-07ec0841015b', 'c20b3121-5677-4a0f-98c4-392518b34241', 'a87c5e42-c668-4982-b964-068742c54245', '9e06eaf7-cb9a-4a35-8bc4-8ee55a169205'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:30 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0d66084b-3f96-4b97-ad2e-cbf6a6ec6635 tempest-GroupSnapshotsV319Test-663823611 None] group_snapshot db0845a0-d494-49b6-8a3c-78581d7caae7: deleted successfully Jul 06 12:10:30 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 2147483648" returned: 0 in 1.217s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:31 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 Jul 06 12:10:31 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Acquiring lock "cinder-quobyte-3235fd6e-dca5-4b74-b107-3d90821e122a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Lock "cinder-quobyte-3235fd6e-dca5-4b74-b107-3d90821e122a" acquired by "delete_volume" :: waited 0.042s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b705b10-7a91-43c0-9b86-d93f4fc5318c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Flow 'volume_create_manager' (da7e8804-c035-477e-8026-f5eaf948126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6538f098-5e0e-4ae4-8c17-6e46b5de23df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6538f098-5e0e-4ae4-8c17-6e46b5de23df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-221836144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507a51f0-dcf0-481b-89e5-5591d854a3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9f1e259e654801963139f2f8c74353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:32Z,use_quota=True,user_id='50b47fa600be47e7925d91675d942428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c0b88f-2ed1-4ad6-b7a5-10c123e4bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c0b88f-2ed1-4ad6-b7a5-10c123e4bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a Jul 06 12:10:32 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc34c67-bcd1-42c0-b306-f5aedbc8f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc34c67-bcd1-42c0-b306-f5aedbc8f21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507a51f0-dcf0-481b-89e5-5591d854a3a1', 'volume_name': 'volume-507a51f0-dcf0-481b-89e5-5591d854a3a1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8d7028-f119-4727-806a-80876f1e6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8d7028-f119-4727-806a-80876f1e6344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d3b0fd-8671-42f5-8cd4-99e49e52b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Volume 507a51f0-dcf0-481b-89e5-5591d854a3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507a51f0-dcf0-481b-89e5-5591d854a3a1', 'volume_size': 1} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:32 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6" returned: 0 in 1.115s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-221836144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507a51f0-dcf0-481b-89e5-5591d854a3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9f1e259e654801963139f2f8c74353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:32Z,use_quota=True,user_id='50b47fa600be47e7925d91675d942428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Creating volume 507a51f0-dcf0-481b-89e5-5591d854a3a1 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:32 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:32 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 1073741824 Jul 06 12:10:32 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370ad01e-28fe-4c17-aa7e-fc94de4820cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6', 'volume_size': 2}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463ea96-1b2c-4bc1-be89-bc752ca7fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Volume volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 (521e5c5f-ff7f-4abd-a388-ce067499e6a6): created successfully Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463ea96-1b2c-4bc1-be89-bc752ca7fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Flow 'volume_create_manager' (97569e69-62df-4426-9689-18861eb163e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:32 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cc3be842-d05e-4faa-8cef-5ff4c47ddd9f tempest-VolumesCloneNegativeTest-622979636 None] Created volume successfully. Jul 06 12:10:32 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a" returned: 0 in 0.961s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:32 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a Jul 06 12:10:32 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Acquiring lock "cinder-521e5c5f-ff7f-4abd-a388-ce067499e6a6-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Lock "cinder-521e5c5f-ff7f-4abd-a388-ce067499e6a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Acquiring lock "cinder-quobyte-521e5c5f-ff7f-4abd-a388-ce067499e6a6" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Lock "cinder-quobyte-521e5c5f-ff7f-4abd-a388-ce067499e6a6" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[db96cb92-a766-4105-be19-9d397e715b92]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:33 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 1073741824" returned: 0 in 1.237s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:33 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 Jul 06 12:10:33 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:33 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 Jul 06 12:10:33 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:33 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3235fd6e-dca5-4b74-b107-3d90821e122a" returned: 0 in 0.933s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Lock "cinder-quobyte-3235fd6e-dca5-4b74-b107-3d90821e122a" released by "delete_volume" :: held 2.045s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Created reservations ['4011551e-6895-4da4-ba48-acda1a687a40'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:33 devstack cinder-volume[86706]: WARNING cinder.quota [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1739732836 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1739732836, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:10:33 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Created reservations ['76c739ba-af7e-416d-bd39-083759389107', 'c47ae03b-f8dc-42c8-9619-0956ddb3e26f', '46948b34-d81d-4293-a181-d6f923b0098c', '3e707caf-fdbb-42de-b19d-0b670540e600'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:34 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:10:34 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:34 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1" returned: 0 in 0.998s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d3b0fd-8671-42f5-8cd4-99e49e52b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507a51f0-dcf0-481b-89e5-5591d854a3a1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec0138a-73b9-4839-a321-eda35110d729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Volume volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 (507a51f0-dcf0-481b-89e5-5591d854a3a1): created successfully Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec0138a-73b9-4839-a321-eda35110d729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Flow 'volume_create_manager' (da7e8804-c035-477e-8026-f5eaf948126f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-495bb82a-6dab-48fa-a034-0701118000ad tempest-AttachVolumeTestJSON-1098345016 None] Created volume successfully. Jul 06 12:10:34 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6" returned: 0 in 1.258s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:34 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6 Jul 06 12:10:34 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:35 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.092s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:35 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e8b79139-b776-437f-a4a7-bbb2d574c8e2 tempest-GroupSnapshotsV319Test-663823611 None] Delete group completed successfully. Jul 06 12:10:35 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-521e5c5f-ff7f-4abd-a388-ce067499e6a6" returned: 0 in 1.168s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Lock "cinder-quobyte-521e5c5f-ff7f-4abd-a388-ce067499e6a6" released by "delete_volume" :: held 2.477s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Created reservations ['db65bfd0-d4cc-4b2c-8d2a-a60cf48e7144', '582002f1-dd49-49d7-b678-beca9eb87faa', '0be4b9ff-8876-4737-8d33-743fda9fd726', '79cbb581-f4a6-436c-bad9-47283ce5027e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:36 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:10:36 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:37 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.127s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:37 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Deleted volume successfully. Jul 06 12:10:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cfc66210-3d68-4dfa-b0b8-7e1104799a4e tempest-VolumesCloneNegativeTest-622979636 None] Lock "cinder-521e5c5f-ff7f-4abd-a388-ce067499e6a6-delete_volume" released by "delete_volume" :: held 3.941s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-7e8a4f30-339c-4799-90e6-9e915025ef5b req-eca0fed1-d9b9-4109-b915-04a02acee5d9 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-7e8a4f30-339c-4799-90e6-9e915025ef5b req-eca0fed1-d9b9-4109-b915-04a02acee5d9 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df5a59-22d7-497f-b444-9f27f676ddf9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-7e8a4f30-339c-4799-90e6-9e915025ef5b req-eca0fed1-d9b9-4109-b915-04a02acee5d9 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:38 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 Jul 06 12:10:38 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:40 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-7e8a4f30-339c-4799-90e6-9e915025ef5b req-eca0fed1-d9b9-4109-b915-04a02acee5d9 tempest-AttachVolumeTestJSON-1098345016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1" returned: 0 in 1.271s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-7e8a4f30-339c-4799-90e6-9e915025ef5b req-eca0fed1-d9b9-4109-b915-04a02acee5d9 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.305s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-7e8a4f30-339c-4799-90e6-9e915025ef5b req-eca0fed1-d9b9-4109-b915-04a02acee5d9 tempest-AttachVolumeTestJSON-1098345016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-507a51f0-dcf0-481b-89e5-5591d854a3a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df4b65fd-1bc5-4941-a6f7-b4a76d37de30', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:10:40 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-7e8a4f30-339c-4799-90e6-9e915025ef5b req-eca0fed1-d9b9-4109-b915-04a02acee5d9 tempest-AttachVolumeTestJSON-1098345016 None] attachment_update completed successfully. Jul 06 12:10:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ffa6f2fd-ac30-4dae-b6e0-45183808740b tempest-GroupsV314Test-1642878731 None] Group tempest-GroupsV314Test-Group-30115975: creating Jul 06 12:10:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ffa6f2fd-ac30-4dae-b6e0-45183808740b tempest-GroupsV314Test-1642878731 None] Group tempest-GroupsV314Test-Group-30115975: created successfully Jul 06 12:10:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ffa6f2fd-ac30-4dae-b6e0-45183808740b tempest-GroupsV314Test-1642878731 None] Create group completed successfully. Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Flow 'volume_create_manager' (dd0df79c-ab51-44f8-bf28-a846a3e6e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3de6d1d-9254-4bee-b6dd-eb5e13db0535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3de6d1d-9254-4bee-b6dd-eb5e13db0535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224257748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6853b564-8397-44e4-8b96-9ac3d5665848,host='devstack@QuobyteHD#QuobyteHD',id=0aeaf09c-54cc-4df5-8909-6b1ce6bfc432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f1225b8d4c411da9e18fb50daab069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:44Z,use_quota=True,user_id='c4267952580845cfa2ba3b7b65fa7d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1b6041a-e521-4698-a539-4c7a29e58ee6),volume_type_id=a1b6041a-e521-4698-a539-4c7a29e58ee6)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46caadd2-17ce-47be-86de-2103d802686c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46caadd2-17ce-47be-86de-2103d802686c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ba98dc-6be5-4801-bbb2-95b59c4093c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ba98dc-6be5-4801-bbb2-95b59c4093c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aeaf09c-54cc-4df5-8909-6b1ce6bfc432', 'volume_name': 'volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d4e1b2-9c09-473b-a568-f78062e09e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d4e1b2-9c09-473b-a568-f78062e09e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7745f5dd-43fc-40b7-a131-7462bbfcecb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Volume 0aeaf09c-54cc-4df5-8909-6b1ce6bfc432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432', 'volume_size': 1} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6853b564-8397-44e4-8b96-9ac3d5665848,created_at=2026-07-06T10:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1224257748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6853b564-8397-44e4-8b96-9ac3d5665848,host='devstack@QuobyteHD#QuobyteHD',id=0aeaf09c-54cc-4df5-8909-6b1ce6bfc432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f1225b8d4c411da9e18fb50daab069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:44Z,use_quota=True,user_id='c4267952580845cfa2ba3b7b65fa7d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1b6041a-e521-4698-a539-4c7a29e58ee6),volume_type_id=a1b6041a-e521-4698-a539-4c7a29e58ee6)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Creating volume 0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:44 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:44 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 1073741824 Jul 06 12:10:44 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Flow 'volume_create_manager' (504f0c25-739c-4566-915e-eaef865b40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5b7801-2df2-4f15-826a-d4f136800a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5b7801-2df2-4f15-826a-d4f136800a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1766814968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26464d0f-ff8a-4c82-9e37-5cb91b9441d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ab726224ab547979aa0fe03cd462ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:45Z,use_quota=True,user_id='ec3b010228454c3c8079f1ab4b0603c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabff94c-102e-40a3-b349-f712495905fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabff94c-102e-40a3-b349-f712495905fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877c382b-3763-4ec5-89c7-e49e12abe8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877c382b-3763-4ec5-89c7-e49e12abe8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26464d0f-ff8a-4c82-9e37-5cb91b9441d3', 'volume_name': 'volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0448fc1-2a54-4251-89ef-ca7ecadfecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0448fc1-2a54-4251-89ef-ca7ecadfecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad698f33-ee80-46f2-94de-4e8fb321c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:44 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Volume 26464d0f-ff8a-4c82-9e37-5cb91b9441d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3', 'volume_size': 1} Jul 06 12:10:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:45 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 1073741824" returned: 0 in 0.980s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:45 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 Jul 06 12:10:45 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Flow 'volume_create_manager' (84cadc6d-d6c1-4d81-9ded-3cb96e1f99f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820426c2-d3f3-4b87-9d1b-3f044f3b0d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820426c2-d3f3-4b87-9d1b-3f044f3b0d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-638361449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2fde78-4191-4c20-98d6-759460f9e308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9f1e259e654801963139f2f8c74353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:45Z,use_quota=True,user_id='50b47fa600be47e7925d91675d942428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6661bbaf-d65c-44d8-90bf-7880848930bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6661bbaf-d65c-44d8-90bf-7880848930bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267b27de-6133-42ef-a258-2479179fe6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267b27de-6133-42ef-a258-2479179fe6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2fde78-4191-4c20-98d6-759460f9e308', 'volume_name': 'volume-1a2fde78-4191-4c20-98d6-759460f9e308', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815b9216-5114-4707-8594-64f7e229954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815b9216-5114-4707-8594-64f7e229954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20932eae-84e7-43fa-b12e-aae0312b180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:45 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Volume 1a2fde78-4191-4c20-98d6-759460f9e308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2fde78-4191-4c20-98d6-759460f9e308', 'volume_size': 1} Jul 06 12:10:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:46 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" returned: 0 in 0.762s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.227s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1766814968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26464d0f-ff8a-4c82-9e37-5cb91b9441d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ab726224ab547979aa0fe03cd462ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:45Z,use_quota=True,user_id='ec3b010228454c3c8079f1ab4b0603c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Creating volume 26464d0f-ff8a-4c82-9e37-5cb91b9441d3 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:46 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7745f5dd-43fc-40b7-a131-7462bbfcecb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:46 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 1073741824 Jul 06 12:10:46 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e5525f-b796-45f8-a248-8c88e6c2027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:46 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Volume volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 (0aeaf09c-54cc-4df5-8909-6b1ce6bfc432): created successfully Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e5525f-b796-45f8-a248-8c88e6c2027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Flow 'volume_create_manager' (dd0df79c-ab51-44f8-bf28-a846a3e6e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-38c9bbc8-32e8-42da-a5ce-e5711bed7803 tempest-GroupsV314Test-1642878731 None] Created volume successfully. Jul 06 12:10:47 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 1073741824" returned: 0 in 1.062s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:47 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 Jul 06 12:10:47 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:48 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3" returned: 0 in 0.755s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.408s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-638361449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2fde78-4191-4c20-98d6-759460f9e308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9f1e259e654801963139f2f8c74353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:45Z,use_quota=True,user_id='50b47fa600be47e7925d91675d942428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Creating volume 1a2fde78-4191-4c20-98d6-759460f9e308 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:48 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:48 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 1073741824 Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:48 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad698f33-ee80-46f2-94de-4e8fb321c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e37d5-3b60-462a-8d7b-54bd6a660a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:48 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Volume volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 (26464d0f-ff8a-4c82-9e37-5cb91b9441d3): created successfully Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e37d5-3b60-462a-8d7b-54bd6a660a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Flow 'volume_create_manager' (504f0c25-739c-4566-915e-eaef865b40f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3b9ce962-fbcd-4702-9135-b89a383f28a9 tempest-VolumesListTestJSON-1763883809 None] Created volume successfully. Jul 06 12:10:49 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 1073741824" returned: 0 in 1.004s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:49 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 Jul 06 12:10:49 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Flow 'volume_create_manager' (8f366f85-4e44-40a6-b369-8ace2dfd66a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21469db5-f74b-4c2b-ad8d-740478157f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21469db5-f74b-4c2b-ad8d-740478157f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1787344948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3a3471-5538-4b03-92f3-2089c5f5a582,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ab726224ab547979aa0fe03cd462ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:50Z,use_quota=True,user_id='ec3b010228454c3c8079f1ab4b0603c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d022dfaf-a32f-47e7-960a-b32eb00cdcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d022dfaf-a32f-47e7-960a-b32eb00cdcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03fe6b8-f52f-4859-a279-a6fe15eb94b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03fe6b8-f52f-4859-a279-a6fe15eb94b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3a3471-5538-4b03-92f3-2089c5f5a582', 'volume_name': 'volume-2d3a3471-5538-4b03-92f3-2089c5f5a582', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef635448-3055-4d2b-9a4e-f7bea6f7896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef635448-3055-4d2b-9a4e-f7bea6f7896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60640fcb-b45f-497b-8b9b-732494cc2d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:49 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Volume 2d3a3471-5538-4b03-92f3-2089c5f5a582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3a3471-5538-4b03-92f3-2089c5f5a582', 'volume_size': 1} Jul 06 12:10:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:50 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308" returned: 0 in 0.926s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.946s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:50 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Cloning volume 0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 to volume 6915f4d4-ac02-498c-83fb-dd7c517af950 Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20932eae-84e7-43fa-b12e-aae0312b180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2fde78-4191-4c20-98d6-759460f9e308', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebe974b-fa8e-44ed-8729-b81c09ad73aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:50 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Volume volume-1a2fde78-4191-4c20-98d6-759460f9e308 (1a2fde78-4191-4c20-98d6-759460f9e308): created successfully Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ebe974b-fa8e-44ed-8729-b81c09ad73aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Flow 'volume_create_manager' (84cadc6d-d6c1-4d81-9ded-3cb96e1f99f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Creating offline snapshot da994fab-133e-4bac-954e-5ea9ca41438d of volume 0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:10:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-435ec7d5-3c28-4d5e-bd87-3489a3fd25f7 tempest-AttachVolumeTestJSON-1098345016 None] Created volume successfully. Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[413c9ea4-4a38-4ef8-8a5e-2c5bbe56d4c9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:50 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 Jul 06 12:10:50 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:51 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" returned: 0 in 0.941s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:51 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d 1G Jul 06 12:10:51 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:51 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d 1G" returned: 0 in 0.912s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:52 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d Jul 06 12:10:52 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:52 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d" returned: 0 in 0.705s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:52 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:10:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:52 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d Jul 06 12:10:52 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:53 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d" returned: 0 in 0.710s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:53 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=53,cinder:UPDATE=59,cinder:INSERT=13,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:53 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=60,cinder:SELECT=65,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:53 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.info Jul 06 12:10:53 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-4cfb7144-f240-44a5-a743-03f2c8a54fcb req-67c3923e-3be4-49f6-80c2-bafa770f414c tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:54 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.info" returned: 0 in 0.710s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:54 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:54 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.info Jul 06 12:10:54 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-3a147314-4ec1-46a7-baa5-486ddf9cb237 req-fec599a6-4455-4364-98bf-592883896337 tempest-ServerActionsTestOtherA-402166127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:54 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.info" returned: 0 in 0.674s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Acquiring lock "cinder-quobyte-6915f4d4-ac02-498c-83fb-dd7c517af950" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-6915f4d4-ac02-498c-83fb-dd7c517af950" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] snapshot: da994fab-133e-4bac-954e-5ea9ca41438d, volume: 6915f4d4-ac02-498c-83fb-dd7c517af950, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c302af5a-0f1a-4503-aebf-b449ab501706]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:55 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d Jul 06 12:10:55 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:55 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d" returned: 0 in 0.773s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:10:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:10:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:10:55 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d71ef1-05c9-4a7f-9323-19ef3da47a69]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:55 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 Jul 06 12:10:55 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:56 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" returned: 0 in 0.789s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:56 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:10:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:56 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 Jul 06 12:10:56 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:00 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950" returned: 0 in 4.315s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[30275516-a010-485f-96a3-77ad5db44fef]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:00 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 Jul 06 12:11:00 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:01 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" returned: 0 in 0.903s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:01 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:11:01 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Converted 1024.00 MB image at 237.27 MB/s Jul 06 12:11:01 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:11:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:01 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 Jul 06 12:11:01 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:02 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950" returned: 0 in 0.712s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-6915f4d4-ac02-498c-83fb-dd7c517af950" released by "_copy_volume_from_snapshot" :: held 7.585s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Acquiring lock "cinder-quobyte-da994fab-133e-4bac-954e-5ea9ca41438d" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-da994fab-133e-4bac-954e-5ea9ca41438d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Deleting offline snapshot da994fab-133e-4bac-954e-5ea9ca41438d of volume 0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] snapshot_file for this snap is: volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6099fe9b-361b-48c5-bbb0-62f8bdd10622]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:02 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d Jul 06 12:11:02 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:03 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d" returned: 0 in 0.905s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:11:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc099a-f3e8-4c1d-be87-73a9f26c8517]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:03 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 Jul 06 12:11:03 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:04 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:11:04 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" returned: 0 in 0.827s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:04 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d Jul 06 12:11:04 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:05 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d" returned: 0 in 0.790s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:05 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d Jul 06 12:11:05 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:05 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432.da994fab-133e-4bac-954e-5ea9ca41438d" returned: 0 in 0.692s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-da994fab-133e-4bac-954e-5ea9ca41438d" released by "_delete_snapshot" :: held 3.325s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.838s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.934s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1787344948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3a3471-5538-4b03-92f3-2089c5f5a582,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ab726224ab547979aa0fe03cd462ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:50Z,use_quota=True,user_id='ec3b010228454c3c8079f1ab4b0603c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Creating volume 2d3a3471-5538-4b03-92f3-2089c5f5a582 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:05 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:11:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:05 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 1073741824 Jul 06 12:11:05 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-eebeaa18-9abc-4ec2-be5d-c7683483f004 tempest-GroupsV314Test-1642878731 None] Create group from source-group-6853b564-8397-44e4-8b96-9ac3d5665848 completed successfully. Jul 06 12:11:06 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 1073741824" returned: 0 in 0.910s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:06 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 Jul 06 12:11:06 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:07 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582" returned: 0 in 0.657s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-4cfb7144-f240-44a5-a743-03f2c8a54fcb req-67c3923e-3be4-49f6-80c2-bafa770f414c tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.560s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60640fcb-b45f-497b-8b9b-732494cc2d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3a3471-5538-4b03-92f3-2089c5f5a582', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c03759-d1cf-4672-b690-f5d5b182dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffac29b-10e4-4058-a83a-5c936b05cbca]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-4cfb7144-f240-44a5-a743-03f2c8a54fcb req-67c3923e-3be4-49f6-80c2-bafa770f414c tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:07 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Volume volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 (2d3a3471-5538-4b03-92f3-2089c5f5a582): created successfully Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c03759-d1cf-4672-b690-f5d5b182dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Flow 'volume_create_manager' (8f366f85-4e44-40a6-b369-8ace2dfd66a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-979b5ea1-6ba5-4ae1-994d-5b7e89fd9c32 tempest-VolumesListTestJSON-1763883809 None] Created volume successfully. Jul 06 12:11:07 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 Jul 06 12:11:07 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:08 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-4cfb7144-f240-44a5-a743-03f2c8a54fcb req-67c3923e-3be4-49f6-80c2-bafa770f414c tempest-AttachVolumeTestJSON-1098345016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308" returned: 0 in 0.787s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-4cfb7144-f240-44a5-a743-03f2c8a54fcb req-67c3923e-3be4-49f6-80c2-bafa770f414c tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-3a147314-4ec1-46a7-baa5-486ddf9cb237 req-fec599a6-4455-4364-98bf-592883896337 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.078s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0821f0-b78a-4f6e-85a4-287dd0791b27]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-3a147314-4ec1-46a7-baa5-486ddf9cb237 req-fec599a6-4455-4364-98bf-592883896337 tempest-ServerActionsTestOtherA-402166127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-4cfb7144-f240-44a5-a743-03f2c8a54fcb req-67c3923e-3be4-49f6-80c2-bafa770f414c tempest-AttachVolumeTestJSON-1098345016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-1a2fde78-4191-4c20-98d6-759460f9e308', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73e003f2-8a0f-4481-a573-2139ed8663e5', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:11:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-4cfb7144-f240-44a5-a743-03f2c8a54fcb req-67c3923e-3be4-49f6-80c2-bafa770f414c tempest-AttachVolumeTestJSON-1098345016 None] attachment_update completed successfully. Jul 06 12:11:08 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d Jul 06 12:11:08 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:09 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-3a147314-4ec1-46a7-baa5-486ddf9cb237 req-fec599a6-4455-4364-98bf-592883896337 tempest-ServerActionsTestOtherA-402166127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" returned: 0 in 0.802s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-3a147314-4ec1-46a7-baa5-486ddf9cb237 req-fec599a6-4455-4364-98bf-592883896337 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.825s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-3a147314-4ec1-46a7-baa5-486ddf9cb237 req-fec599a6-4455-4364-98bf-592883896337 tempest-ServerActionsTestOtherA-402166127 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01cfeefa-76cb-44a6-b135-7e21c3176e85', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:11:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-3a147314-4ec1-46a7-baa5-486ddf9cb237 req-fec599a6-4455-4364-98bf-592883896337 tempest-ServerActionsTestOtherA-402166127 None] attachment_update completed successfully. Jul 06 12:11:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Acquiring lock "cinder-quobyte-6915f4d4-ac02-498c-83fb-dd7c517af950" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-6915f4d4-ac02-498c-83fb-dd7c517af950" acquired by "delete_volume" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb425691-58bb-46af-8992-7637cb435f43]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:10 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 Jul 06 12:11:10 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Flow 'volume_create_manager' (fda9fff3-56a6-46ac-855b-c2b0f24a3cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d369eb6-817e-4eff-9790-26e717c430ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d369eb6-817e-4eff-9790-26e717c430ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1483123251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ceb6820-1985-4672-8216-de75d7d31b1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ab726224ab547979aa0fe03cd462ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:10Z,use_quota=True,user_id='ec3b010228454c3c8079f1ab4b0603c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277f2d9b-7055-4493-a245-80872c39c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277f2d9b-7055-4493-a245-80872c39c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3b73d9-5270-4cc9-832e-93d4597f1d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3b73d9-5270-4cc9-832e-93d4597f1d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ceb6820-1985-4672-8216-de75d7d31b1e', 'volume_name': 'volume-7ceb6820-1985-4672-8216-de75d7d31b1e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de94c92-7751-4899-a0fb-a2b5c07e9ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de94c92-7751-4899-a0fb-a2b5c07e9ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7345d458-32b9-4b6e-bda4-8329cb5239fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:10 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Volume 7ceb6820-1985-4672-8216-de75d7d31b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ceb6820-1985-4672-8216-de75d7d31b1e', 'volume_size': 1} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1483123251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ceb6820-1985-4672-8216-de75d7d31b1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ab726224ab547979aa0fe03cd462ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:10Z,use_quota=True,user_id='ec3b010228454c3c8079f1ab4b0603c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Creating volume 7ceb6820-1985-4672-8216-de75d7d31b1e {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:10 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:11:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:10 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e 1073741824 Jul 06 12:11:10 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:11 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950" returned: 0 in 1.026s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:11 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950 Jul 06 12:11:11 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:11 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e 1073741824" returned: 0 in 1.080s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:11 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e Jul 06 12:11:11 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:11 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6915f4d4-ac02-498c-83fb-dd7c517af950" returned: 0 in 0.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-6915f4d4-ac02-498c-83fb-dd7c517af950" released by "delete_volume" :: held 1.869s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Created reservations ['069fc8c0-f75d-449a-ade3-f45b6ab3d65b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:11 devstack cinder-volume[86706]: WARNING cinder.quota [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-987576823 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-987576823, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:11:11 devstack cinder-volume[86706]: WARNING cinder.quota [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-987576823 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-987576823, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:11:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Created reservations ['7805365f-7844-4cf3-b987-00b1ccfe1736', '73984411-3c6b-4673-8408-0347b84500d5', '2cadfeac-e216-4ebb-8442-e34dfc13bb66', '1794e5a8-0ffd-4718-9338-8a2eeb5a0ac5'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:12 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:12 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:12 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e" returned: 0 in 0.781s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7345d458-32b9-4b6e-bda4-8329cb5239fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ceb6820-1985-4672-8216-de75d7d31b1e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e8f981-5251-477f-8787-0559ad35a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:12 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Volume volume-7ceb6820-1985-4672-8216-de75d7d31b1e (7ceb6820-1985-4672-8216-de75d7d31b1e): created successfully Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e8f981-5251-477f-8787-0559ad35a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Flow 'volume_create_manager' (fda9fff3-56a6-46ac-855b-c2b0f24a3cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-01d77588-3b60-4b52-8074-7545ef566710 tempest-VolumesListTestJSON-1763883809 None] Created volume successfully. Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Acquiring lock "cinder-quobyte-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eac345-1884-4f7e-809b-8443292e08b2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:12 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.885s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:13 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:13 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 Jul 06 12:11:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b540bd06-289f-4f22-8bc0-98c8eb2af22e tempest-GroupsV314Test-1642878731 None] Delete group completed successfully. Jul 06 12:11:13 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:13 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" returned: 0 in 0.932s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:13 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432 Jul 06 12:11:13 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:14 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" returned: 0 in 0.857s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Lock "cinder-quobyte-0aeaf09c-54cc-4df5-8909-6b1ce6bfc432" released by "delete_volume" :: held 1.924s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-e8c51022-20f2-479e-ae2e-9fe642fb26c4 req-68342833-ec1a-4c08-9450-66d846cc0fe1 tempest-AttachVolumeTestJSON-1098345016 None] Terminate volume connection completed successfully. Jul 06 12:11:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-e8c51022-20f2-479e-ae2e-9fe642fb26c4 req-68342833-ec1a-4c08-9450-66d846cc0fe1 tempest-AttachVolumeTestJSON-1098345016 None] Deleting attachment df4b65fd-1bc5-4941-a6f7-b4a76d37de30. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:11:14 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Created reservations ['30eafb7b-c806-42f5-98e2-9e5d1ce393e1'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:14 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Created reservations ['72c7a693-e827-4047-b78d-d0d16e5fc2b5', '26bbb812-ca68-4edd-963e-1cff7414fb7e', '375eff8d-b303-4872-ba22-2aff73f40106', '0a2c046e-c234-47dd-b3ab-513d7bfdbd46'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:15 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:15 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:16 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.060s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:16 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3aa03748-4c79-44c7-923b-06820309fd07 tempest-GroupsV314Test-1642878731 None] Delete group completed successfully. Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "cinder-7ceb6820-1985-4672-8216-de75d7d31b1e-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-7ceb6820-1985-4672-8216-de75d7d31b1e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "cinder-quobyte-7ceb6820-1985-4672-8216-de75d7d31b1e" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-quobyte-7ceb6820-1985-4672-8216-de75d7d31b1e" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2803c0dd-8397-449c-8c6c-bf8852b4347f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:16 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e Jul 06 12:11:16 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-dcb03a04-54e3-47b3-a93e-350b8a6e1ec4 req-617b0c61-c4b4-4553-b39f-d6fae77ddb01 tempest-AttachVolumeTestJSON-1098345016 None] Terminate volume connection completed successfully. Jul 06 12:11:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-dcb03a04-54e3-47b3-a93e-350b8a6e1ec4 req-617b0c61-c4b4-4553-b39f-d6fae77ddb01 tempest-AttachVolumeTestJSON-1098345016 None] Deleting attachment 73e003f2-8a0f-4481-a573-2139ed8663e5. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:11:17 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e" returned: 0 in 1.122s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-46bb142a-e07b-41bc-8081-41e7bb282221 tempest-ServerActionsTestOtherA-402166127 None] Terminate volume connection completed successfully. Jul 06 12:11:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-46bb142a-e07b-41bc-8081-41e7bb282221 tempest-ServerActionsTestOtherA-402166127 None] Deleting attachment 01cfeefa-76cb-44a6-b135-7e21c3176e85. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:11:17 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e Jul 06 12:11:17 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:18 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7ceb6820-1985-4672-8216-de75d7d31b1e" returned: 0 in 0.888s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-quobyte-7ceb6820-1985-4672-8216-de75d7d31b1e" released by "delete_volume" :: held 2.060s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Created reservations ['ad5b9601-f41b-46bc-86b4-afe2bcc53b4e', 'b506a2be-dbc6-48ad-871d-019421a5c9d0', 'cc2bc3eb-fbf0-4970-a376-30d4270b3bf7', 'a362aaac-e296-42ad-9816-d3f8f0a50ef8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:19 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:19 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:19 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.018s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:19 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Deleted volume successfully. Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b062a1c-26d7-4b77-bc7c-ed6d20864ba3 tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-7ceb6820-1985-4672-8216-de75d7d31b1e-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "cinder-2d3a3471-5538-4b03-92f3-2089c5f5a582-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-2d3a3471-5538-4b03-92f3-2089c5f5a582-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "cinder-quobyte-2d3a3471-5538-4b03-92f3-2089c5f5a582" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-quobyte-2d3a3471-5538-4b03-92f3-2089c5f5a582" acquired by "delete_volume" :: waited 0.038s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76017ff-d041-4805-a371-977ef41d7fc6]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:20 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 Jul 06 12:11:20 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-1bb060c6-1fc5-4860-af1b-0a86dc7fab2b tempest-ServerActionsTestOtherA-402166127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-1bb060c6-1fc5-4860-af1b-0a86dc7fab2b tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b82d68-a66c-48b6-b788-743bf0071bbb]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-1bb060c6-1fc5-4860-af1b-0a86dc7fab2b tempest-ServerActionsTestOtherA-402166127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:20 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d Jul 06 12:11:20 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:21 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582" returned: 0 in 1.127s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:21 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582 Jul 06 12:11:21 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:21 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-1bb060c6-1fc5-4860-af1b-0a86dc7fab2b tempest-ServerActionsTestOtherA-402166127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" returned: 0 in 1.050s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-1bb060c6-1fc5-4860-af1b-0a86dc7fab2b tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.081s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-1bb060c6-1fc5-4860-af1b-0a86dc7fab2b tempest-ServerActionsTestOtherA-402166127 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb14ea14-1324-42e0-a1ba-69d6c05f0a71', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:11:21 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-d396c49e-9706-4e39-86a0-3a9b1f26e9df req-1bb060c6-1fc5-4860-af1b-0a86dc7fab2b tempest-ServerActionsTestOtherA-402166127 None] attachment_update completed successfully. Jul 06 12:11:22 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2d3a3471-5538-4b03-92f3-2089c5f5a582" returned: 0 in 1.034s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-quobyte-2d3a3471-5538-4b03-92f3-2089c5f5a582" released by "delete_volume" :: held 2.238s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Created reservations ['50b677ce-351d-42c5-9b46-f28a90d903f4', 'de1a9a49-7bad-4203-819a-b19e5c1fcc1a', '2e8e2e92-8c56-4697-803b-55429f8937bb', 'cd622794-7f4f-4d59-ab48-fe1042af37d9'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:22 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:22 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:23 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.086s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:23 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "cinder-26464d0f-ff8a-4c82-9e37-5cb91b9441d3-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Deleted volume successfully. Jul 06 12:11:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-26464d0f-ff8a-4c82-9e37-5cb91b9441d3-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a81894f-3bef-470e-8ae8-d4f9dc5a3ace tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-2d3a3471-5538-4b03-92f3-2089c5f5a582-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "cinder-quobyte-26464d0f-ff8a-4c82-9e37-5cb91b9441d3" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-quobyte-26464d0f-ff8a-4c82-9e37-5cb91b9441d3" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:24 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7df850-2efe-4488-862e-0a60f2062bd2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:24 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 Jul 06 12:11:24 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:25 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3" returned: 0 in 0.977s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:25 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3 Jul 06 12:11:25 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:25 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-26464d0f-ff8a-4c82-9e37-5cb91b9441d3" returned: 0 in 0.875s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-quobyte-26464d0f-ff8a-4c82-9e37-5cb91b9441d3" released by "delete_volume" :: held 1.931s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Created reservations ['aae64390-0a39-4bf8-9e21-14ea902b1cd5', 'b133bea7-085f-45e8-8155-b5efba5a373f', 'a1b9a2b9-c05f-4631-8903-bf8fd8fbf7c1', '06c69a42-28ca-47d5-a511-4c490f20c5bd'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:26 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:26 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:27 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:27 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:27 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.174s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:27 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Deleted volume successfully. Jul 06 12:11:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1feaa61e-8c9a-4b5e-bddf-d227f285aa3c tempest-VolumesListTestJSON-1763883809 None] Lock "cinder-26464d0f-ff8a-4c82-9e37-5cb91b9441d3-delete_volume" released by "delete_volume" :: held 3.496s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:28 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.050s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:11:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:11:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:11:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "cinder-1a2fde78-4191-4c20-98d6-759460f9e308-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-1a2fde78-4191-4c20-98d6-759460f9e308-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "cinder-quobyte-1a2fde78-4191-4c20-98d6-759460f9e308" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-quobyte-1a2fde78-4191-4c20-98d6-759460f9e308" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:30 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b985b0-24f1-4c06-aee2-aa4eeedc45e7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:30 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 Jul 06 12:11:30 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:31 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Flow 'volume_create_manager' (b41e0e14-b839-4583-ab88-3f0f13306e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a550de-3a14-4244-9f37-902b921e27b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a550de-3a14-4244-9f37-902b921e27b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-605149166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78eaba79-a00a-43ce-8cb4-7e300fc3a74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3b40d75cda4655bc775e4f3cc59bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:32Z,use_quota=True,user_id='57b50a09ed104c1fa188594d9fd90a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8a5f29-8f76-4a64-b791-c507a7d91862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8a5f29-8f76-4a64-b791-c507a7d91862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbe7071-1586-4b55-bc4b-9431358189ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbe7071-1586-4b55-bc4b-9431358189ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78eaba79-a00a-43ce-8cb4-7e300fc3a74b', 'volume_name': 'volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef24818e-1790-445d-b01d-f107ce02f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef24818e-1790-445d-b01d-f107ce02f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2fcd63-d265-46ba-b457-a82b9bc8ca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Volume 78eaba79-a00a-43ce-8cb4-7e300fc3a74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b', 'volume_size': 1} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-605149166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78eaba79-a00a-43ce-8cb4-7e300fc3a74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3b40d75cda4655bc775e4f3cc59bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:32Z,use_quota=True,user_id='57b50a09ed104c1fa188594d9fd90a0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Creating volume 78eaba79-a00a-43ce-8cb4-7e300fc3a74b {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:32 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:32 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b 1073741824 Jul 06 12:11:32 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:32 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308" returned: 0 in 1.659s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:32 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308 Jul 06 12:11:32 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:33 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1a2fde78-4191-4c20-98d6-759460f9e308" returned: 0 in 0.995s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-quobyte-1a2fde78-4191-4c20-98d6-759460f9e308" released by "delete_volume" :: held 2.724s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Flow 'volume_create_manager' (d32f7af8-d01c-467c-aa22-14e7c18b6ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e51f2d-c11b-41b2-b7c9-e529ddb1474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:33 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b 1073741824" returned: 0 in 1.362s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e51f2d-c11b-41b2-b7c9-e529ddb1474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1093139966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03f16eb-2be1-4288-91e2-c0346b399270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbdfa6108d442aeaa90e5d1f2c29fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:33Z,use_quota=True,user_id='1a31f8389ed44d7b899848a0dd8efe00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c6b45e-7873-4199-b26e-7c53d983c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c6b45e-7873-4199-b26e-7c53d983c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d93d60-8a00-4780-afec-650cade78d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d93d60-8a00-4780-afec-650cade78d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03f16eb-2be1-4288-91e2-c0346b399270', 'volume_name': 'volume-c03f16eb-2be1-4288-91e2-c0346b399270', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c525e71d-048c-48de-8359-14be70e97912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c525e71d-048c-48de-8359-14be70e97912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3868cf8c-b49f-4367-9392-c238b533734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Volume c03f16eb-2be1-4288-91e2-c0346b399270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03f16eb-2be1-4288-91e2-c0346b399270', 'volume_size': 1} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Created reservations ['cdeeb2a1-269a-43ad-85bc-d0fa6589b8e4', '00f00bad-465d-4d0b-92da-9ffcfcf07dc1', 'e706b276-1cdf-448b-8890-e5ed95c4fa4b', '78f972b3-d669-4338-afb7-34b7c7dadbef'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:33 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b Jul 06 12:11:33 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:33 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:33 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "cinder-507a51f0-dcf0-481b-89e5-5591d854a3a1-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-507a51f0-dcf0-481b-89e5-5591d854a3a1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "cinder-quobyte-507a51f0-dcf0-481b-89e5-5591d854a3a1" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-quobyte-507a51f0-dcf0-481b-89e5-5591d854a3a1" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aee019-a8d2-4a1a-b0cb-16816103b6e8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:34 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 Jul 06 12:11:34 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:34 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b" returned: 0 in 0.779s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1093139966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03f16eb-2be1-4288-91e2-c0346b399270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbdfa6108d442aeaa90e5d1f2c29fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:33Z,use_quota=True,user_id='1a31f8389ed44d7b899848a0dd8efe00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Creating volume c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:34 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2fcd63-d265-46ba-b457-a82b9bc8ca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:34 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 1073741824 Jul 06 12:11:34 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83248cd9-cf36-40ac-9a12-3f4c8b07f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Volume volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b (78eaba79-a00a-43ce-8cb4-7e300fc3a74b): created successfully Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83248cd9-cf36-40ac-9a12-3f4c8b07f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Flow 'volume_create_manager' (b41e0e14-b839-4583-ab88-3f0f13306e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-04552ce8-e0e2-4ac9-8735-cb4cf1cd1a34 tempest-VolumesNegativeTest-1558690267 None] Created volume successfully. Jul 06 12:11:34 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.933s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Deleted volume successfully. Jul 06 12:11:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-32ee7201-2995-4f02-b0ee-0503e4690b67 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-1a2fde78-4191-4c20-98d6-759460f9e308-delete_volume" released by "delete_volume" :: held 4.185s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:35 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1" returned: 0 in 1.142s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:35 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1 Jul 06 12:11:35 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:35 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 1073741824" returned: 0 in 1.073s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:35 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 Jul 06 12:11:35 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:36 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-507a51f0-dcf0-481b-89e5-5591d854a3a1" returned: 0 in 1.102s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-quobyte-507a51f0-dcf0-481b-89e5-5591d854a3a1" released by "delete_volume" :: held 2.365s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Created reservations ['4773eb97-ea34-4dd8-927e-2e723781154d', 'e75e8e94-7ae2-421a-a2d3-147a8642d3ee', '5fd774e1-8784-42c0-8164-2b20ff1fd6cd', '5e8738dd-77f2-41c4-a5b1-e5d668f61fff'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:36 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270" returned: 0 in 1.225s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] <== create_volume: return (2370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3868cf8c-b49f-4367-9392-c238b533734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03f16eb-2be1-4288-91e2-c0346b399270', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a946c2d-483d-46c3-a88d-d3263d7df8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Volume volume-c03f16eb-2be1-4288-91e2-c0346b399270 (c03f16eb-2be1-4288-91e2-c0346b399270): created successfully Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a946c2d-483d-46c3-a88d-d3263d7df8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Flow 'volume_create_manager' (d32f7af8-d01c-467c-aa22-14e7c18b6ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-21e93215-fef9-472f-a603-8da719f7f3ea tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Created volume successfully. Jul 06 12:11:37 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:37 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "cinder-e71844bb-1d12-4f33-95fe-e2af5eb89c25-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-e71844bb-1d12-4f33-95fe-e2af5eb89c25-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "cinder-quobyte-e71844bb-1d12-4f33-95fe-e2af5eb89c25" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:37 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-quobyte-e71844bb-1d12-4f33-95fe-e2af5eb89c25" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.797s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Deleted volume successfully. Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6049b2e-5a69-4306-8206-037ab2ce9145]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4670f31-b4f5-4314-be33-f45a17f15578 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-507a51f0-dcf0-481b-89e5-5591d854a3a1-delete_volume" released by "delete_volume" :: held 3.742s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:37 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 Jul 06 12:11:37 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Creating offline snapshot 302786b0-9a98-45e4-8a1d-878a72e07c20 of volume c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:11:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bde52d4-ce1e-453e-98cb-4d36b630711b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:38 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 Jul 06 12:11:38 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:38 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25" returned: 0 in 1.032s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:38 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25 Jul 06 12:11:38 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:39 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270" returned: 0 in 0.834s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:39 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 1G Jul 06 12:11:39 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:39 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e71844bb-1d12-4f33-95fe-e2af5eb89c25" returned: 0 in 0.708s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-quobyte-e71844bb-1d12-4f33-95fe-e2af5eb89c25" released by "delete_volume" :: held 1.796s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Created reservations ['fdd47feb-f9bd-4c73-ad6e-cf4e1fe7e98b', '56b49014-b53e-4a5c-b7ac-411409417070', 'a3e1c098-befa-4542-a04b-40f84e4e9fe4', '4de2aac5-842a-4cbd-b932-4bc81122b2b3'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:39 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:39 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:40 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 1G" returned: 0 in 1.098s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c03f16eb-2be1-4288-91e2-c0346b399270 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:40 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c03f16eb-2be1-4288-91e2-c0346b399270 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 Jul 06 12:11:40 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:40 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:40 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:40 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Deleted volume successfully. Jul 06 12:11:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-55a9482d-a485-4c66-9a54-0e3e06e65de4 tempest-AttachVolumeTestJSON-1098345016 None] Lock "cinder-e71844bb-1d12-4f33-95fe-e2af5eb89c25-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:41 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c03f16eb-2be1-4288-91e2-c0346b399270 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20" returned: 0 in 1.023s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:41 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 is being set with open permissions: ugo+rw Jul 06 12:11:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:41 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 Jul 06 12:11:41 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:41 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20" returned: 0 in 0.746s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:42 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.info Jul 06 12:11:42 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:42 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.info" returned: 0 in 0.914s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:42 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.info is being set with open permissions: ugo+rw Jul 06 12:11:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:42 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.info Jul 06 12:11:42 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:44 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.info" returned: 0 in 1.199s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.926s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c0a60309-1ea5-44e8-8ed7-7a4143866577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Create snapshot completed successfully Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "cinder-302786b0-9a98-45e4-8a1d-878a72e07c20-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-302786b0-9a98-45e4-8a1d-878a72e07c20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "cinder-quobyte-c03f16eb-2be1-4288-91e2-c0346b399270" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-quobyte-c03f16eb-2be1-4288-91e2-c0346b399270" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "cinder-quobyte-302786b0-9a98-45e4-8a1d-878a72e07c20" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-quobyte-302786b0-9a98-45e4-8a1d-878a72e07c20" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Deleting offline snapshot 302786b0-9a98-45e4-8a1d-878a72e07c20 of volume c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] snapshot_file for this snap is: volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e189577-ac81-4b5d-8901-5d2b1a94e0fe]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:45 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 Jul 06 12:11:45 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:46 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20" returned: 0 in 1.081s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c03f16eb-2be1-4288-91e2-c0346b399270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:11:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e293ce-d3f3-411b-a904-0119ec7d5665]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:46 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 Jul 06 12:11:46 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:47 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270" returned: 0 in 0.944s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:47 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 Jul 06 12:11:47 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:48 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20" returned: 0 in 0.817s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:48 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20 Jul 06 12:11:48 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:49 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270.302786b0-9a98-45e4-8a1d-878a72e07c20" returned: 0 in 0.851s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-quobyte-302786b0-9a98-45e4-8a1d-878a72e07c20" released by "_delete_snapshot" :: held 3.822s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-quobyte-c03f16eb-2be1-4288-91e2-c0346b399270" released by "delete_snapshot" :: held 3.855s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:49 devstack cinder-volume[86706]: WARNING cinder.quota [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Created reservations ['9e5a2998-a037-48b1-b073-938e84b2a46a', '7721dd77-a007-4632-9005-88317b1a82a2', '3130d5b4-4cfc-408b-9955-c48ee14ad37a', 'a3a00501-839f-4f89-995d-be9ea3019258'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Delete snapshot completed successfully. Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-03d6837c-0122-4217-b7bb-145e2c45cd53 tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-302786b0-9a98-45e4-8a1d-878a72e07c20-delete_snapshot" released by "delete_snapshot" :: held 4.037s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "cinder-c03f16eb-2be1-4288-91e2-c0346b399270-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-c03f16eb-2be1-4288-91e2-c0346b399270-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "cinder-quobyte-c03f16eb-2be1-4288-91e2-c0346b399270" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-quobyte-c03f16eb-2be1-4288-91e2-c0346b399270" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dd7b6d-a844-4373-b98d-b1bc9e2eea51]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:49 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 Jul 06 12:11:49 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86547da6-2a51-45a5-bf90-034aa3e14f06 tempest-BackendsCapabilitiesAdminTestsJSON-138764056 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86706) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:11:50 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270" returned: 0 in 1.060s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:50 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270 Jul 06 12:11:50 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69084ef8-e319-4f46-a296-0460ca73cfae tempest-BackendsCapabilitiesAdminTestsJSON-138764056 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86706) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:11:51 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c03f16eb-2be1-4288-91e2-c0346b399270" returned: 0 in 0.876s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-quobyte-c03f16eb-2be1-4288-91e2-c0346b399270" released by "delete_volume" :: held 2.018s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Created reservations ['e938eb55-6b9d-4142-8868-57999a274c22', '2ea603a6-bdf3-4a24-b217-3f106b4d94df', '7bc4f349-b6bc-4bb4-bf38-57f1168d49ea', 'fdef6b72-e7a7-4200-ae6a-e43ad67365fc'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:51 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:11:51 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:52 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.860s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:52 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:52 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Deleted volume successfully. Jul 06 12:11:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ac34d47e-4946-499b-bad1-3571e0a2ac5e tempest-VolumeSnapshotQuotasNegativeTestJSON-2122264890 None] Lock "cinder-c03f16eb-2be1-4288-91e2-c0346b399270-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:56 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=99,cinder:UPDATE=107,cinder:INSERT=27,cinder:DELETE=5 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:11:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-48e8e1b8-77b1-4444-b7f1-4ff3ccb82e51 req-a918c41a-5833-4435-bdfd-e4a1dae324e9 tempest-ServerActionsTestOtherA-402166127 None] Terminate volume connection completed successfully. Jul 06 12:11:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-48e8e1b8-77b1-4444-b7f1-4ff3ccb82e51 req-a918c41a-5833-4435-bdfd-e4a1dae324e9 tempest-ServerActionsTestOtherA-402166127 None] Deleting attachment fb14ea14-1324-42e0-a1ba-69d6c05f0a71. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:12:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c739a4c2-72c4-411b-8a9f-c5cb48e10322 tempest-GroupsTest-293424828 None] Group tempest-Group1-2055273079: creating Jul 06 12:12:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c739a4c2-72c4-411b-8a9f-c5cb48e10322 tempest-GroupsTest-293424828 None] Group tempest-Group1-2055273079: created successfully Jul 06 12:12:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c739a4c2-72c4-411b-8a9f-c5cb48e10322 tempest-GroupsTest-293424828 None] Create group completed successfully. Jul 06 12:12:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5f7bf93d-ca34-4f6b-aaf2-9e23785a6b21 tempest-GroupsTest-293424828 None] Group tempest-Group2-1113934072: creating Jul 06 12:12:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5f7bf93d-ca34-4f6b-aaf2-9e23785a6b21 tempest-GroupsTest-293424828 None] Group tempest-Group2-1113934072: created successfully Jul 06 12:12:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5f7bf93d-ca34-4f6b-aaf2-9e23785a6b21 tempest-GroupsTest-293424828 None] Create group completed successfully. Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Flow 'volume_create_manager' (e7934039-bfc0-4e55-8c65-abc42dcadff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a47b38-655e-47f5-a1aa-b16b13dc15cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a47b38-655e-47f5-a1aa-b16b13dc15cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220012403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=737ac1ea-b209-431c-9655-94feec0da454,host='devstack@QuobyteHD#QuobyteHD',id=08835293-dc3f-44ab-b2e2-b50954f13a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccda5e1a4b8402682032a1ece71847d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:03Z,use_quota=True,user_id='b6fbb2b87d784b3f8fca3d858cb0370d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6d98dd1-8991-4e1f-b37a-3090b6580896),volume_type_id=f6d98dd1-8991-4e1f-b37a-3090b6580896)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783afb5-33f3-473b-9e7b-948ddf2a7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783afb5-33f3-473b-9e7b-948ddf2a7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c92d5-8b3d-4906-af2a-923dfcca560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c92d5-8b3d-4906-af2a-923dfcca560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08835293-dc3f-44ab-b2e2-b50954f13a0a', 'volume_name': 'volume-08835293-dc3f-44ab-b2e2-b50954f13a0a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e4b6d4-0aab-43e2-9b70-5f6fa0e4c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e4b6d4-0aab-43e2-9b70-5f6fa0e4c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d52c62-89aa-49f9-8b7f-6b92b813c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:03 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Volume 08835293-dc3f-44ab-b2e2-b50954f13a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08835293-dc3f-44ab-b2e2-b50954f13a0a', 'volume_size': 1} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=737ac1ea-b209-431c-9655-94feec0da454,created_at=2026-07-06T10:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220012403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=737ac1ea-b209-431c-9655-94feec0da454,host='devstack@QuobyteHD#QuobyteHD',id=08835293-dc3f-44ab-b2e2-b50954f13a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccda5e1a4b8402682032a1ece71847d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:03Z,use_quota=True,user_id='b6fbb2b87d784b3f8fca3d858cb0370d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6d98dd1-8991-4e1f-b37a-3090b6580896),volume_type_id=f6d98dd1-8991-4e1f-b37a-3090b6580896)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Creating volume 08835293-dc3f-44ab-b2e2-b50954f13a0a {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:03 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:12:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:03 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a 1073741824 Jul 06 12:12:03 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:04 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a 1073741824" returned: 0 in 1.069s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:04 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=106,cinder:SELECT=85,cinder:DELETE=7,cinder:INSERT=21 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:04 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a Jul 06 12:12:04 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:05 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a" returned: 0 in 0.779s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d52c62-89aa-49f9-8b7f-6b92b813c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08835293-dc3f-44ab-b2e2-b50954f13a0a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e2d837-9284-4d9e-8832-d9405dfafe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:05 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Volume volume-08835293-dc3f-44ab-b2e2-b50954f13a0a (08835293-dc3f-44ab-b2e2-b50954f13a0a): created successfully Jul 06 12:12:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e2d837-9284-4d9e-8832-d9405dfafe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Flow 'volume_create_manager' (e7934039-bfc0-4e55-8c65-abc42dcadff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c996e200-c554-46ca-96d9-40d97f9c8854 tempest-GroupsTest-293424828 None] Created volume successfully. Jul 06 12:12:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Acquiring lock "cinder-quobyte-08835293-dc3f-44ab-b2e2-b50954f13a0a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Lock "cinder-quobyte-08835293-dc3f-44ab-b2e2-b50954f13a0a" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8cac0d-240a-4330-973b-68cb50f66b41]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:07 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a Jul 06 12:12:07 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:08 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a" returned: 0 in 1.292s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:08 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a Jul 06 12:12:08 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Acquiring lock "cinder-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Lock "cinder-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Acquiring lock "cinder-quobyte-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Lock "cinder-quobyte-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" acquired by "delete_volume" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4209688-912b-4a17-b78e-e58106743551]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:09 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d Jul 06 12:12:09 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:09 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-08835293-dc3f-44ab-b2e2-b50954f13a0a" returned: 0 in 1.160s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Lock "cinder-quobyte-08835293-dc3f-44ab-b2e2-b50954f13a0a" released by "delete_volume" :: held 2.545s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Created reservations ['6fa72a06-7bb4-43d8-963d-15380bf04b3f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:09 devstack cinder-volume[86706]: WARNING cinder.quota [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1827033224 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1827033224, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:12:09 devstack cinder-volume[86706]: WARNING cinder.quota [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1827033224 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1827033224, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Created reservations ['510e68cd-52b4-4e6a-bc33-66d2de005e18', 'dff2ebde-17ee-48a2-8fde-8d7470617337', 'db1df23f-f51a-45c3-abf4-535b3f4559f5', 'a5d1bc1f-dc1e-4d8f-aeea-19b0cb6a20e5'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:10 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:10 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:10 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" returned: 0 in 1.321s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:10 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d Jul 06 12:12:10 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:11 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.054s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-883c5b4d-f6af-41e4-b416-7ffe6d4eb101 tempest-GroupsTest-293424828 None] Delete group completed successfully. Jul 06 12:12:11 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" returned: 0 in 1.020s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Lock "cinder-quobyte-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d" released by "delete_volume" :: held 2.403s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Created reservations ['d644c6df-d3d9-4410-9cc6-7025548e4cdd', '53fd553f-f0b1-4145-b330-1017b949615e', 'b977005b-8393-446b-bb57-45bc5fdddd49', 'bf0645f8-1856-4b7a-a21c-edecfc37709f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Created reservations ['3bf01166-d76f-4f07-b098-6ba7c848dcac'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:11 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:11 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:11 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:11 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:12 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.059s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d524a794-d68f-4fcc-ace7-fce5d005f284 tempest-GroupsTest-293424828 None] Delete group completed successfully. Jul 06 12:12:12 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.139s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Deleted volume successfully. Jul 06 12:12:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa92856c-53b1-418f-b151-60480487a154 tempest-ServerActionsTestOtherA-402166127 None] Lock "cinder-9edcdabe-7acd-4de2-be4a-af2b7f8c7b1d-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-736d9c21-6bde-4526-a193-05febee4ace2 tempest-GroupsTest-293424828 None] Group tempest-GroupsTest-Group-1289031924: creating Jul 06 12:12:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-736d9c21-6bde-4526-a193-05febee4ace2 tempest-GroupsTest-293424828 None] Group tempest-GroupsTest-Group-1289031924: created successfully Jul 06 12:12:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-736d9c21-6bde-4526-a193-05febee4ace2 tempest-GroupsTest-293424828 None] Create group completed successfully. Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Flow 'volume_create_manager' (b3db31ee-ad52-4ba2-a454-bf1117f65cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54299a9-db3b-4564-8452-ea1a5d883ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54299a9-db3b-4564-8452-ea1a5d883ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621373975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d3f56d-b617-4286-adf8-1e37eb24efa0,host='devstack@QuobyteHD#QuobyteHD',id=c25ad454-3dfc-42d0-8ae7-5dded6258b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccda5e1a4b8402682032a1ece71847d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:15Z,use_quota=True,user_id='b6fbb2b87d784b3f8fca3d858cb0370d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f21f03-b9eb-439a-8310-1190d8d18eef),volume_type_id=15f21f03-b9eb-439a-8310-1190d8d18eef)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cb78c-6eea-4388-8dac-323c1e178687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cb78c-6eea-4388-8dac-323c1e178687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2da394-53c3-4645-8537-2dbc946fc1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2da394-53c3-4645-8537-2dbc946fc1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25ad454-3dfc-42d0-8ae7-5dded6258b60', 'volume_name': 'volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e4e440-c151-4c03-aa4d-e550ac8a56a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e4e440-c151-4c03-aa4d-e550ac8a56a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8019c1e5-9784-4a25-8343-738160386a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:15 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Volume c25ad454-3dfc-42d0-8ae7-5dded6258b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60', 'volume_size': 1} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95d3f56d-b617-4286-adf8-1e37eb24efa0,created_at=2026-07-06T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621373975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d3f56d-b617-4286-adf8-1e37eb24efa0,host='devstack@QuobyteHD#QuobyteHD',id=c25ad454-3dfc-42d0-8ae7-5dded6258b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccda5e1a4b8402682032a1ece71847d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:15Z,use_quota=True,user_id='b6fbb2b87d784b3f8fca3d858cb0370d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f21f03-b9eb-439a-8310-1190d8d18eef),volume_type_id=15f21f03-b9eb-439a-8310-1190d8d18eef)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Creating volume c25ad454-3dfc-42d0-8ae7-5dded6258b60 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:15 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:12:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:15 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 1073741824 Jul 06 12:12:15 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:17 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 1073741824" returned: 0 in 1.490s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:17 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 Jul 06 12:12:17 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Acquiring lock "cinder-78eaba79-a00a-43ce-8cb4-7e300fc3a74b-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Lock "cinder-78eaba79-a00a-43ce-8cb4-7e300fc3a74b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Acquiring lock "cinder-quobyte-78eaba79-a00a-43ce-8cb4-7e300fc3a74b" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Lock "cinder-quobyte-78eaba79-a00a-43ce-8cb4-7e300fc3a74b" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57e4a4d-3b54-4792-a730-95f2ccafb605]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:17 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b Jul 06 12:12:17 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:18 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60" returned: 0 in 0.988s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.575s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8019c1e5-9784-4a25-8343-738160386a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f5eae2-6011-457b-bc8b-13b1755c810d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:18 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Volume volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 (c25ad454-3dfc-42d0-8ae7-5dded6258b60): created successfully Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f5eae2-6011-457b-bc8b-13b1755c810d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Flow 'volume_create_manager' (b3db31ee-ad52-4ba2-a454-bf1117f65cc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-732d52fa-ffe0-43ec-b096-e8505ec7f558 tempest-GroupsTest-293424828 None] Created volume successfully. Jul 06 12:12:18 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b" returned: 0 in 1.024s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:18 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b Jul 06 12:12:18 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:19 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-78eaba79-a00a-43ce-8cb4-7e300fc3a74b" returned: 0 in 0.778s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Lock "cinder-quobyte-78eaba79-a00a-43ce-8cb4-7e300fc3a74b" released by "delete_volume" :: held 1.858s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Created reservations ['6c70d885-2d17-46ae-b305-7f017a3c23cc', '343c5b13-6b74-47fe-8f3c-9f96ed4e8e72', '9905e5ab-219f-40b2-b6f0-daaa47d8de45', 'db293388-eb3c-49d6-b29f-2bacf7bf112f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:19 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:19 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Flow 'volume_create_manager' (5e3ee17c-747d-42b9-bc73-dfe963d7c814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b7f1c0-53c5-4ba0-ab7a-4fe14edfc842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b7f1c0-53c5-4ba0-ab7a-4fe14edfc842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1554763031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d3f56d-b617-4286-adf8-1e37eb24efa0,host='devstack@QuobyteHD#QuobyteHD',id=9b7d00e3-5f3c-420d-94fa-7dde099c554f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccda5e1a4b8402682032a1ece71847d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:20Z,use_quota=True,user_id='b6fbb2b87d784b3f8fca3d858cb0370d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f21f03-b9eb-439a-8310-1190d8d18eef),volume_type_id=15f21f03-b9eb-439a-8310-1190d8d18eef)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6244e1d-f027-4f08-a3df-0e5a0ed8641a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6244e1d-f027-4f08-a3df-0e5a0ed8641a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b147c1-33ee-4a3f-8399-59d6bf6c6f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b147c1-33ee-4a3f-8399-59d6bf6c6f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7d00e3-5f3c-420d-94fa-7dde099c554f', 'volume_name': 'volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905dc367-9638-4681-b4ac-6439796f187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905dc367-9638-4681-b4ac-6439796f187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6c9f1-0766-4807-96cc-19500a36c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:20 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Volume 9b7d00e3-5f3c-420d-94fa-7dde099c554f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f', 'volume_size': 1} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95d3f56d-b617-4286-adf8-1e37eb24efa0,created_at=2026-07-06T10:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1554763031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d3f56d-b617-4286-adf8-1e37eb24efa0,host='devstack@QuobyteHD#QuobyteHD',id=9b7d00e3-5f3c-420d-94fa-7dde099c554f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccda5e1a4b8402682032a1ece71847d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:20Z,use_quota=True,user_id='b6fbb2b87d784b3f8fca3d858cb0370d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f21f03-b9eb-439a-8310-1190d8d18eef),volume_type_id=15f21f03-b9eb-439a-8310-1190d8d18eef)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Creating volume 9b7d00e3-5f3c-420d-94fa-7dde099c554f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:20 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:20 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f 1073741824 Jul 06 12:12:20 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:20 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.312s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Deleted volume successfully. Jul 06 12:12:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c9b8ce9-361f-4ddc-988c-0813f33de252 tempest-VolumesNegativeTest-1558690267 None] Lock "cinder-78eaba79-a00a-43ce-8cb4-7e300fc3a74b-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:21 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f 1073741824" returned: 0 in 1.455s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:21 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f Jul 06 12:12:21 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:22 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f" returned: 0 in 0.798s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6c9f1-0766-4807-96cc-19500a36c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1ec909-94fd-4cef-91e4-7761d0a4afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:22 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Volume volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f (9b7d00e3-5f3c-420d-94fa-7dde099c554f): created successfully Jul 06 12:12:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1ec909-94fd-4cef-91e4-7761d0a4afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Flow 'volume_create_manager' (5e3ee17c-747d-42b9-bc73-dfe963d7c814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e67237bb-35cb-4d82-99e0-92252f0e5719 tempest-GroupsTest-293424828 None] Created volume successfully. Jul 06 12:12:23 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Flow 'volume_create_manager' (5227f825-9263-428e-8fb6-46748924a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b739d-dfad-4b7c-8b10-dbc04d5b95fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b739d-dfad-4b7c-8b10-dbc04d5b95fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1646846030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ab6d58a05b4e4a91ed907bd5248479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:24Z,use_quota=True,user_id='4aee77e4d598464c98fa900caea94d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1700ef-e48f-4df8-b25b-a71a176496c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1700ef-e48f-4df8-b25b-a71a176496c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f84e413-7d55-4122-8765-8b6a5c0ec225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f84e413-7d55-4122-8765-8b6a5c0ec225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0', 'volume_name': 'volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0', 'volume_size': 2}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821b8d97-7bbc-429f-87c8-30ceb4d29760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821b8d97-7bbc-429f-87c8-30ceb4d29760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26664209-681c-45d0-b40a-2e950b87afa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:24 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Volume e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0', 'volume_size': 2} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1646846030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ab6d58a05b4e4a91ed907bd5248479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:24Z,use_quota=True,user_id='4aee77e4d598464c98fa900caea94d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Creating volume e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:24 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:12:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 2147483648 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:24 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 2147483648 Jul 06 12:12:24 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:24 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e7f9fbf4-ddb9-4920-a15f-2a1c0b5d5fe8 tempest-GroupsTest-293424828 None] Update group completed successfully. Jul 06 12:12:25 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 2147483648" returned: 0 in 1.125s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:25 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 Jul 06 12:12:25 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-598e2135-caf5-4711-9047-6e118a229a3e tempest-GroupsTest-293424828 None] Update group completed successfully. Jul 06 12:12:26 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" returned: 0 in 0.964s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26664209-681c-45d0-b40a-2e950b87afa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0', 'volume_size': 2}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd391d38-f96e-477e-8a51-eac0f3bae910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:26 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Volume volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 (e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0): created successfully Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd391d38-f96e-477e-8a51-eac0f3bae910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Flow 'volume_create_manager' (5227f825-9263-428e-8fb6-46748924a089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:26 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3dfd85b6-40b8-4b4a-aa55-e5874ba82db7 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Created volume successfully. Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:27 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:27 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Creating offline snapshot a58b6bfd-3aad-40b9-b416-d89b1d97cd67 of volume e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf5d11-133e-47d7-ba23-14984a950cf9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:28 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 Jul 06 12:12:28 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:28 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Acquiring lock "cinder-quobyte-9b7d00e3-5f3c-420d-94fa-7dde099c554f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.303s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Lock "cinder-quobyte-9b7d00e3-5f3c-420d-94fa-7dde099c554f" acquired by "delete_volume" :: waited 0.058s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b578864f-71f7-4a71-b39b-67b2c7409100]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:28 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f Jul 06 12:12:28 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:29 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" returned: 0 in 1.426s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 2G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:29 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 2G Jul 06 12:12:29 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:29 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f" returned: 0 in 1.441s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:29 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f Jul 06 12:12:29 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:30 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 2G" returned: 0 in 1.216s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:30 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 Jul 06 12:12:30 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:30 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9b7d00e3-5f3c-420d-94fa-7dde099c554f" returned: 0 in 0.903s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Lock "cinder-quobyte-9b7d00e3-5f3c-420d-94fa-7dde099c554f" released by "delete_volume" :: held 2.396s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Acquiring lock "cinder-quobyte-c25ad454-3dfc-42d0-8ae7-5dded6258b60" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Lock "cinder-quobyte-c25ad454-3dfc-42d0-8ae7-5dded6258b60" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e40ba-cdc7-4388-9af2-47f8acf406bd]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:30 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 Jul 06 12:12:30 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:31 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67" returned: 0 in 1.071s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:31 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 is being set with open permissions: ugo+rw Jul 06 12:12:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:31 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 Jul 06 12:12:31 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:32 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60" returned: 0 in 1.256s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:32 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60 Jul 06 12:12:32 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:32 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67" returned: 0 in 0.942s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:32 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.info Jul 06 12:12:32 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:32 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c25ad454-3dfc-42d0-8ae7-5dded6258b60" returned: 0 in 0.897s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Lock "cinder-quobyte-c25ad454-3dfc-42d0-8ae7-5dded6258b60" released by "delete_volume" :: held 2.224s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Created reservations ['e9ab0dae-af9a-4cfc-bdea-5f297aa5e7fc'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:33 devstack cinder-volume[86706]: WARNING cinder.quota [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-349698823 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-349698823, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:12:33 devstack cinder-volume[86706]: WARNING cinder.quota [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-349698823 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-349698823, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Created reservations ['5b698c92-d58c-4e3d-9400-08b4c1fa252f', 'e06e7f57-c767-4e9d-ab76-c6dfefdf41bf', '57fa6f58-62ee-40b5-8cbd-33ff12ed589c', 'ded99e07-00f8-4492-96f6-72366931b482'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Created reservations ['1d8589f9-6912-48e1-b81e-83688bb5a812', '87f59bbe-d43c-4f3e-83ec-1f352da19636', '1297a8ed-6232-469f-ab4c-eb1e41101274', '771295a2-f01e-44ec-b273-b6b1a622c102'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:33 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.info" returned: 0 in 1.041s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:33 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.info is being set with open permissions: ugo+rw Jul 06 12:12:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:33 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:33 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:33 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.info Jul 06 12:12:33 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:34 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.000s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:34 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-479b4197-39e2-41d6-8d4e-77401caf3467 tempest-GroupsTest-293424828 None] Delete group completed successfully. Jul 06 12:12:34 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.info" returned: 0 in 1.097s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.970s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fd160e08-6e48-44bd-83c5-f89c76f175e1 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Create snapshot completed successfully Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "cinder-a58b6bfd-3aad-40b9-b416-d89b1d97cd67-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-a58b6bfd-3aad-40b9-b416-d89b1d97cd67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "cinder-quobyte-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-quobyte-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "cinder-quobyte-a58b6bfd-3aad-40b9-b416-d89b1d97cd67" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-quobyte-a58b6bfd-3aad-40b9-b416-d89b1d97cd67" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Deleting offline snapshot a58b6bfd-3aad-40b9-b416-d89b1d97cd67 of volume e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] snapshot_file for this snap is: volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f527830-72f4-4bdf-8335-e8505ac10f35]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:35 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 Jul 06 12:12:35 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:36 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67" returned: 0 in 1.212s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:36 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eb99a2-f69b-463e-b14d-3070f776dced]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:37 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 Jul 06 12:12:37 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:38 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" returned: 0 in 1.152s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:38 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 Jul 06 12:12:38 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:39 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67" returned: 0 in 0.946s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:39 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67 Jul 06 12:12:39 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:40 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0.a58b6bfd-3aad-40b9-b416-d89b1d97cd67" returned: 0 in 0.932s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-quobyte-a58b6bfd-3aad-40b9-b416-d89b1d97cd67" released by "_delete_snapshot" :: held 4.403s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-quobyte-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" released by "delete_snapshot" :: held 4.461s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:40 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Created reservations ['1600a35d-7182-4067-9469-b156c8d54bb8', 'cf8c460c-1ce7-44db-8bfe-2a1f753eab16', 'b559a0b4-3329-498f-86b7-5b7018a9b4c7', '482c00ce-c740-46d6-acfe-5bc032932724'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:40 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Delete snapshot completed successfully. Jul 06 12:12:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a64fe6fb-f60a-48ce-8327-59b577cdc85f tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-a58b6bfd-3aad-40b9-b416-d89b1d97cd67-delete_snapshot" released by "delete_snapshot" :: held 4.657s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "cinder-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "cinder-quobyte-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-quobyte-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:41 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa568979-250b-48fc-83d8-33bb3c251e64]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:41 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 Jul 06 12:12:41 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c1defdb8-b1b6-4726-9436-fec0b9cbf08d tempest-GroupsV320Test-752287369 None] Group tempest-GroupsV320Test-Group-1354670899: creating Jul 06 12:12:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c1defdb8-b1b6-4726-9436-fec0b9cbf08d tempest-GroupsV320Test-752287369 None] Group tempest-GroupsV320Test-Group-1354670899: created successfully Jul 06 12:12:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c1defdb8-b1b6-4726-9436-fec0b9cbf08d tempest-GroupsV320Test-752287369 None] Create group completed successfully. Jul 06 12:12:42 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" returned: 0 in 1.188s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:42 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0 Jul 06 12:12:42 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:43 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" returned: 0 in 1.062s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-quobyte-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0" released by "delete_volume" :: held 2.323s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Created reservations ['a8be4fcf-8311-404a-b6b6-76610b1df69a', '716568a2-6811-466d-a644-56531e4fd54e', '6e7aae4a-6db1-4689-b40f-f86d5af68560', '3a5e3dea-f898-402f-91ba-81943b07c1aa'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Created reservations ['f242a1a1-0da7-4c47-89c6-4a19546c7655'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:43 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:43 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:43 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:12:43 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:44 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.003s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:44 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-89e62e2c-8c8f-486d-9a14-8f838e13824b tempest-GroupsV320Test-752287369 None] Delete group completed successfully. Jul 06 12:12:45 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.395s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:45 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Deleted volume successfully. Jul 06 12:12:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-949d095e-9a84-485c-9033-4617bdc06401 tempest-VolumesSnapshotNegativeTestJSON-1270394358 None] Lock "cinder-e2c922c1-1e91-4b5e-a788-d8e4dc43e2d0-delete_volume" released by "delete_volume" :: held 4.155s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:53 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=73,cinder:UPDATE=82,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:53 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Flow 'volume_create_manager' (6e2c0370-a0f4-47c0-b125-117d1da227ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97fab56-a61b-4cc4-9420-e11ac8b99b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97fab56-a61b-4cc4-9420-e11ac8b99b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1966761823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57b767d-e8eb-4772-a6a5-09565c4c9ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c90a32042774eadb72697c2beed67f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:54Z,use_quota=True,user_id='051052a684d747ec8ffda92dc1a91dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f9006-b1f0-4a51-83e4-58306e62a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f9006-b1f0-4a51-83e4-58306e62a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4195af22-0571-4269-a8c0-9b4064a7761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4195af22-0571-4269-a8c0-9b4064a7761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57b767d-e8eb-4772-a6a5-09565c4c9ce8', 'volume_name': 'volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbe016b-9970-41be-9eab-bb0f0829e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fbe016b-9970-41be-9eab-bb0f0829e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf26c76-8a70-4604-b086-9ed5214b2d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:54 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8', 'volume_size': 1} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1966761823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57b767d-e8eb-4772-a6a5-09565c4c9ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c90a32042774eadb72697c2beed67f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:54Z,use_quota=True,user_id='051052a684d747ec8ffda92dc1a91dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Creating volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:54 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:12:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:54 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 1073741824 Jul 06 12:12:54 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:55 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 1073741824" returned: 0 in 1.276s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:55 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 Jul 06 12:12:55 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:56 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" returned: 0 in 1.045s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.407s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf26c76-8a70-4604-b086-9ed5214b2d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509cb486-e32a-41d1-9052-b4877ef9b3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Volume volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 (e57b767d-e8eb-4772-a6a5-09565c4c9ce8): created successfully Jul 06 12:12:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509cb486-e32a-41d1-9052-b4877ef9b3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Flow 'volume_create_manager' (6e2c0370-a0f4-47c0-b125-117d1da227ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6b196a19-d75d-411b-8d18-a0db5675de4a tempest-SnapshotsActionsTest-375270549 None] Created volume successfully. Jul 06 12:12:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Creating offline snapshot 08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b9299a-5a50-4c40-baea-71cb33323552]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:58 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 Jul 06 12:12:58 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:59 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" returned: 0 in 1.529s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:59 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 1G Jul 06 12:12:59 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:01 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 1G" returned: 0 in 1.398s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:01 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:01 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:02 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.515s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:02 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 is being set with open permissions: ugo+rw Jul 06 12:13:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:02 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:02 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:03 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.295s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:04 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.info Jul 06 12:13:04 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:05 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.info" returned: 0 in 1.195s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:05 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.info is being set with open permissions: ugo+rw Jul 06 12:13:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:05 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.info Jul 06 12:13:05 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:06 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.info" returned: 0 in 1.059s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.244s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:06 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=84,cinder:SELECT=75,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:13:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-da161069-6f2a-471b-9adc-af894a996fcb tempest-SnapshotsActionsTest-375270549 None] Create snapshot completed successfully Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (020b6a47-fa31-4904-a045-efbcb6c38bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a054e79-2cf0-42ea-a19f-b855aa039fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a054e79-2cf0-42ea-a19f-b855aa039fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755397343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59be2057-6415-4e50-98cd-b33679af5b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:07Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7553abe3-ea3d-4232-9cd4-13a74f00ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7553abe3-ea3d-4232-9cd4-13a74f00ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ab8ac-8e65-49f7-9677-92ed10742f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ab8ac-8e65-49f7-9677-92ed10742f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59be2057-6415-4e50-98cd-b33679af5b0b', 'volume_name': 'volume-59be2057-6415-4e50-98cd-b33679af5b0b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053d6924-d652-471f-9eab-075e4811c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053d6924-d652-471f-9eab-075e4811c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625e66b4-8439-4916-a238-087580507a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:07 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Volume 59be2057-6415-4e50-98cd-b33679af5b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59be2057-6415-4e50-98cd-b33679af5b0b', 'volume_size': 1} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755397343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59be2057-6415-4e50-98cd-b33679af5b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:07Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Creating volume 59be2057-6415-4e50-98cd-b33679af5b0b {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:07 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:07 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b 1073741824 Jul 06 12:13:07 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:09 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b 1073741824" returned: 0 in 2.189s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:10 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b Jul 06 12:13:10 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:10 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b" returned: 0 in 0.960s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] <== create_volume: return (3247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.258s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.997s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Creating offline snapshot 27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:13:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625e66b4-8439-4916-a238-087580507a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59be2057-6415-4e50-98cd-b33679af5b0b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88154833-dca1-473d-9d8d-c4b4b05dd64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:11 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Volume volume-59be2057-6415-4e50-98cd-b33679af5b0b (59be2057-6415-4e50-98cd-b33679af5b0b): created successfully Jul 06 12:13:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88154833-dca1-473d-9d8d-c4b4b05dd64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (020b6a47-fa31-4904-a045-efbcb6c38bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:11 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75a342d-37be-4f06-9709-66eeefde54b8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4c818876-2480-4030-8972-48b7761fbaad tempest-VolumesActionsTest-2054149800 None] Created volume successfully. Jul 06 12:13:11 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:11 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f7c7b9-7b0e-40a0-bc59-674cc5d4d6f6 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b" by "attach_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f7c7b9-7b0e-40a0-bc59-674cc5d4d6f6 tempest-VolumesActionsTest-2054149800 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b" acquired by "attach_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a2f7c7b9-7b0e-40a0-bc59-674cc5d4d6f6 tempest-VolumesActionsTest-2054149800 None] Attaching volume 59be2057-6415-4e50-98cd-b33679af5b0b to instance 604610d1-5cd2-475d-bbaf-f504a9345b60 at mountpoint /dev/vdb on host None. Jul 06 12:13:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a2f7c7b9-7b0e-40a0-bc59-674cc5d4d6f6 tempest-VolumesActionsTest-2054149800 None] Attach volume completed successfully. Jul 06 12:13:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a2f7c7b9-7b0e-40a0-bc59-674cc5d4d6f6 tempest-VolumesActionsTest-2054149800 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b" released by "attach_volume" :: held 0.167s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:12 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.120s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:12 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 1G Jul 06 12:13:12 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:13 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-67089c99-b151-4a3c-80e7-eb524f5fb41f tempest-VolumesActionsTest-200804529 None] Terminate volume connection completed successfully. Jul 06 12:13:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 1G" returned: 0 in 1.316s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:13 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 Jul 06 12:13:13 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-67089c99-b151-4a3c-80e7-eb524f5fb41f tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-detach_volume" by "detach_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-67089c99-b151-4a3c-80e7-eb524f5fb41f tempest-VolumesActionsTest-200804529 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-67089c99-b151-4a3c-80e7-eb524f5fb41f tempest-VolumesActionsTest-200804529 None] Detaching volume 59be2057-6415-4e50-98cd-b33679af5b0b from instance 604610d1-5cd2-475d-bbaf-f504a9345b60. Jul 06 12:13:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-67089c99-b151-4a3c-80e7-eb524f5fb41f tempest-VolumesActionsTest-200804529 None] Detach volume completed successfully. Jul 06 12:13:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-67089c99-b151-4a3c-80e7-eb524f5fb41f tempest-VolumesActionsTest-200804529 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:14 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" returned: 0 in 0.792s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:14 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 is being set with open permissions: ugo+rw Jul 06 12:13:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:14 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 Jul 06 12:13:14 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6b65f37f-b0bd-4a62-84b5-6fbe42073daa tempest-VolumesActionsTest-2054149800 None] Acquiring lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-detach_volume" by "detach_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6b65f37f-b0bd-4a62-84b5-6fbe42073daa tempest-VolumesActionsTest-2054149800 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6b65f37f-b0bd-4a62-84b5-6fbe42073daa tempest-VolumesActionsTest-2054149800 None] Volume detach called, but volume not attached. Jul 06 12:13:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6b65f37f-b0bd-4a62-84b5-6fbe42073daa tempest-VolumesActionsTest-2054149800 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:15 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" returned: 0 in 0.835s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.224s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:15 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4c15da9e-0986-4d8d-9aef-860d975676e1 tempest-SnapshotsActionsTest-375270549 None] Create snapshot completed successfully Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Acquiring lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Acquiring lock "cinder-quobyte-59be2057-6415-4e50-98cd-b33679af5b0b" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-27c35131-fb0f-4ef2-9a1c-43e771f7dcf9-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-27c35131-fb0f-4ef2-9a1c-43e771f7dcf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Lock "cinder-quobyte-59be2057-6415-4e50-98cd-b33679af5b0b" acquired by "delete_volume" :: waited 0.068s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d219ed5-f136-40b8-bd73-74df20ff3ad2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Deleting offline snapshot 27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] snapshot_file for this snap is: volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd6529-fb22-467d-baf1-2288d2219083]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:15 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b Jul 06 12:13:15 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:15 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 Jul 06 12:13:15 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:16 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b" returned: 0 in 1.135s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:16 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b Jul 06 12:13:16 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:16 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" returned: 0 in 1.153s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd93c6-104d-4cb0-8cd2-7b5740055088]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:17 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:17 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:18 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-59be2057-6415-4e50-98cd-b33679af5b0b" returned: 0 in 1.532s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Lock "cinder-quobyte-59be2057-6415-4e50-98cd-b33679af5b0b" released by "delete_volume" :: held 2.749s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Created reservations ['8e657459-871f-4bef-9283-17cb423555a9', '96679f5c-c3c9-4626-8c92-90cc7e274cb1', 'b8b7bbfe-09ca-46d2-adce-04c950ad2ec5', '305145a7-0fb1-4e76-a1a1-f8fe291aee44'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:18 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:13:18 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:18 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.942s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:18 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 Jul 06 12:13:18 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:20 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.852s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:20 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Deleted volume successfully. Jul 06 12:13:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d7ef3ab2-0f8d-4e39-9501-65b829480dcf tempest-VolumesActionsTest-2054149800 None] Lock "cinder-59be2057-6415-4e50-98cd-b33679af5b0b-delete_volume" released by "delete_volume" :: held 5.161s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:20 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" returned: 0 in 1.746s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:20 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9 Jul 06 12:13:20 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:22 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" returned: 0 in 1.441s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-27c35131-fb0f-4ef2-9a1c-43e771f7dcf9" released by "_delete_snapshot" :: held 6.474s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" released by "delete_snapshot" :: held 6.518s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:22 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Created reservations ['e702d5ba-9020-467c-ad11-04c375db0278', '08f8b067-6cda-4605-a897-f60616bf4d2a', 'f19a83c9-632f-4ac0-ae50-c93f3d434990', 'f87a0ffc-4607-47b4-8f1b-e228a4047b6e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Delete snapshot completed successfully. Jul 06 12:13:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-867dba27-8b87-488a-b933-a2a6478a10c1 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-27c35131-fb0f-4ef2-9a1c-43e771f7dcf9-delete_snapshot" released by "delete_snapshot" :: held 6.919s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Creating offline snapshot 57a4b179-dc5b-448f-a2af-281077c7a9b5 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:13:24 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae2895-fb02-48f2-8d70-59a3456977ec]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:24 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:24 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:26 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 2.125s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:26 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 1G Jul 06 12:13:26 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:13:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:27 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:13:27 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:29 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 1G" returned: 0 in 2.667s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:29 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 2.372s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:29 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:29 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 Jul 06 12:13:29 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:29 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:13:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:13:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:13:31 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5" returned: 0 in 1.789s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:31 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 is being set with open permissions: ugo+rw Jul 06 12:13:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:31 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 Jul 06 12:13:31 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (188d7d9f-2796-4cd0-ae36-8e50e4ac7e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f7dd69-de21-48e1-95b6-9c924314d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f7dd69-de21-48e1-95b6-9c924314d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-226324018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe010743-1155-48dc-bce0-68b5dde92b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:32Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be80243b-faca-4807-814b-24670d166986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be80243b-faca-4807-814b-24670d166986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992821b6-722f-4fe5-b7e7-f59d92c1e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992821b6-722f-4fe5-b7e7-f59d92c1e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe010743-1155-48dc-bce0-68b5dde92b94', 'volume_name': 'volume-fe010743-1155-48dc-bce0-68b5dde92b94', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3f5d73-0524-48ec-a9c4-1d2cd8e2ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3f5d73-0524-48ec-a9c4-1d2cd8e2ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d657901-65ea-426a-910e-e93f54fd5390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Volume fe010743-1155-48dc-bce0-68b5dde92b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe010743-1155-48dc-bce0-68b5dde92b94', 'volume_size': 1} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:32 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5" returned: 0 in 1.748s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.596s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-226324018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe010743-1155-48dc-bce0-68b5dde92b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:32Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Creating volume fe010743-1155-48dc-bce0-68b5dde92b94 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:33 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:33 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 1073741824 Jul 06 12:13:33 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-80bcdcab-5225-4975-9e44-191fb004c4c1 tempest-SnapshotsActionsTest-375270549 None] Create snapshot completed successfully Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-57a4b179-dc5b-448f-a2af-281077c7a9b5-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-57a4b179-dc5b-448f-a2af-281077c7a9b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-57a4b179-dc5b-448f-a2af-281077c7a9b5" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-57a4b179-dc5b-448f-a2af-281077c7a9b5" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Deleting offline snapshot 57a4b179-dc5b-448f-a2af-281077c7a9b5 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] snapshot_file for this snap is: volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f33e246-a6ba-47ec-9b30-4f5fb45ecba8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:33 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 Jul 06 12:13:33 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:34 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 1073741824" returned: 0 in 1.395s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:34 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 Jul 06 12:13:34 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:34 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5" returned: 0 in 1.156s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:34 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02e714-8704-43eb-9a11-869d8b39d468]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:34 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:34 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:35 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94" returned: 0 in 0.790s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d657901-65ea-426a-910e-e93f54fd5390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe010743-1155-48dc-bce0-68b5dde92b94', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5e14e7-bbbd-46ba-8046-0defbd77490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:35 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Volume volume-fe010743-1155-48dc-bce0-68b5dde92b94 (fe010743-1155-48dc-bce0-68b5dde92b94): created successfully Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5e14e7-bbbd-46ba-8046-0defbd77490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (188d7d9f-2796-4cd0-ae36-8e50e4ac7e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:35 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-86d2962f-1b4b-4524-89bb-3a098b4123e7 tempest-VolumesActionsTest-2054149800 None] Created volume successfully. Jul 06 12:13:35 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 0.904s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:35 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 Jul 06 12:13:35 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-fe010743-1155-48dc-bce0-68b5dde92b94-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Lock "cinder-fe010743-1155-48dc-bce0-68b5dde92b94-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-quobyte-fe010743-1155-48dc-bce0-68b5dde92b94" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-fe010743-1155-48dc-bce0-68b5dde92b94" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:36 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5" returned: 0 in 1.034s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b4a5bc-9c48-4dd9-8e78-a9396fc21b88]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:36 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5 Jul 06 12:13:36 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:36 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 Jul 06 12:13:36 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Flow 'volume_create_manager' (c5d290b4-0073-4e4a-b06e-2c9e73b42f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99abf8e0-9d35-473c-aa24-7c01c087e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99abf8e0-9d35-473c-aa24-7c01c087e21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1060085471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4380c6-e8b9-464b-920b-e03736478207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327b869094364d0482b667ebcf60b830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:37Z,use_quota=True,user_id='048ff113b55a43eeb532db5e6472f0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e79a8-a321-4bd3-afe8-c884ebb4294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e79a8-a321-4bd3-afe8-c884ebb4294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e524b7e-cb1b-4c4b-b51c-4beb3c6a9e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:13:37 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.57a4b179-dc5b-448f-a2af-281077c7a9b5" returned: 0 in 0.848s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-57a4b179-dc5b-448f-a2af-281077c7a9b5" released by "_delete_snapshot" :: held 4.104s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" released by "delete_snapshot" :: held 4.151s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Created reservations ['9e870480-8bbc-4eef-947e-473fd810ba62', '8bac74b7-5c1e-4495-8b9f-f2ac256edb96', 'a49d627e-ac97-438b-9722-e0d2a4476332', '0e537a50-948f-4768-b3fc-7e6aa3d35ed2'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:37 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94" returned: 0 in 1.038s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Delete snapshot completed successfully. Jul 06 12:13:37 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94 Jul 06 12:13:37 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4f694f8-2542-494a-bedb-d6c76ab2aec8 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-57a4b179-dc5b-448f-a2af-281077c7a9b5-delete_snapshot" released by "delete_snapshot" :: held 4.396s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e524b7e-cb1b-4c4b-b51c-4beb3c6a9e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d4380c6-e8b9-464b-920b-e03736478207', 'volume_name': 'volume-3d4380c6-e8b9-464b-920b-e03736478207', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851f78de-a6f7-46ad-95a9-5f188cd7202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851f78de-a6f7-46ad-95a9-5f188cd7202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c03911-df78-4d3c-8596-31fbad49b605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:38 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Volume 3d4380c6-e8b9-464b-920b-e03736478207: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d4380c6-e8b9-464b-920b-e03736478207', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Trying to clone 3d4380c6-e8b9-464b-920b-e03736478207 from image b501de2b-75f2-48fc-a750-711c22cfabf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:13:38 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe010743-1155-48dc-bce0-68b5dde92b94" returned: 0 in 0.865s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-fe010743-1155-48dc-bce0-68b5dde92b94" released by "delete_volume" :: held 1.986s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:13:38 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Created reservations ['41fe86b6-0ad4-46d9-a9d4-8cd93ba62bc4', '2951c196-72e2-4794-a65b-972d0385bbab', 'd676fe45-c0e1-451a-9575-1c7b98aee8ad', '376cf5d6-58cf-48b8-bfbe-dd946e828a5b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d05d1bc-a6fa-4b91-87f3-a66da05c1aae]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:39 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:13:39 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:39 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD Jul 06 12:13:39 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Creating offline snapshot f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98b21c-a592-4472-8be3-9446e7c57422]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:39 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:39 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:39 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.817s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Deleted volume successfully. Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0bcfdabc-4010-4c2a-a13b-dec9b20577b4 tempest-VolumesActionsTest-200804529 None] Lock "cinder-fe010743-1155-48dc-bce0-68b5dde92b94-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:39 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD" returned: 0 in 1.037s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:39 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 is fetched for user 048ff113b55a43eeb532db5e6472f0b6. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:13:40 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4554ae4-8548-41ed-8dc3-c85ffee78dd3]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:40 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD Jul 06 12:13:40 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:40 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.349s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:40 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c 1G Jul 06 12:13:40 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (274bc876-a63e-4ac2-bb0b-5ef0ec5f2181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c28acb-eeda-48df-a599-dcbb5b0eeeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c28acb-eeda-48df-a599-dcbb5b0eeeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630558342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409c444e-0f3a-4c03-8e00-cace680476c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:41Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06093605-8abd-47e2-ac93-c3339cae595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06093605-8abd-47e2-ac93-c3339cae595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6885b8d7-e183-421d-b76e-f3af272ca7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6885b8d7-e183-421d-b76e-f3af272ca7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409c444e-0f3a-4c03-8e00-cace680476c8', 'volume_name': 'volume-409c444e-0f3a-4c03-8e00-cace680476c8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc85a5f5-92b9-4f37-9a9a-57193411f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc85a5f5-92b9-4f37-9a9a-57193411f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125f630a-1228-4341-b9f3-31940589ae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:41 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Volume 409c444e-0f3a-4c03-8e00-cace680476c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409c444e-0f3a-4c03-8e00-cace680476c8', 'volume_size': 1} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:41 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD" returned: 0 in 1.404s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:42 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c 1G" returned: 0 in 1.415s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:42 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c Jul 06 12:13:42 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:42 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" returned: 0 in 0.827s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:42 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c is being set with open permissions: ugo+rw Jul 06 12:13:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:42 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c Jul 06 12:13:42 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:43 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" returned: 0 in 0.794s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.521s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.515s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630558342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409c444e-0f3a-4c03-8e00-cace680476c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:41Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Creating volume 409c444e-0f3a-4c03-8e00-cace680476c8 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:43 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:43 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 1073741824 Jul 06 12:13:43 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:43 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-18b083a3-e4b6-43cb-beda-4623b23bf746 tempest-SnapshotsActionsTest-375270549 None] Create snapshot completed successfully Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Flow 'volume_create_manager' (40f35565-e29e-4662-8704-6f30fdfea608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fde1a7-e30f-4f5d-9f86-2ccbcc78d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fde1a7-e30f-4f5d-9f86-2ccbcc78d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1990100153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abe81bd-4a97-4a67-9cac-edb51d10ea87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db6acb8c2854e56a2262aabbeab01ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:44Z,use_quota=True,user_id='3cb7374faf124fd9847419a5578e753b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e665e9-94a0-464e-aa26-f205d328b060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e665e9-94a0-464e-aa26-f205d328b060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa76fc5b-8d14-4858-9083-1e5b1f5259d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa76fc5b-8d14-4858-9083-1e5b1f5259d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abe81bd-4a97-4a67-9cac-edb51d10ea87', 'volume_name': 'volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52d68e3-d735-4fc3-bf63-9683954c5021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52d68e3-d735-4fc3-bf63-9683954c5021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa55cbd-dd26-46a9-b072-ed7ceabf47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:44 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Volume 7abe81bd-4a97-4a67-9cac-edb51d10ea87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87', 'volume_size': 1} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Deleting offline snapshot f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] snapshot_file for this snap is: volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8249d6-5c7a-4146-8664-8e50c00157ab]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:45 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 1073741824" returned: 0 in 1.354s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:45 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c Jul 06 12:13:45 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:45 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 Jul 06 12:13:45 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:46 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" returned: 0 in 1.292s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39f23c6-446e-4af5-b478-4a7aabc8d51a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:46 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8" returned: 0 in 1.134s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] <== create_volume: return (2559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.563s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.752s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1060085471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4380c6-e8b9-464b-920b-e03736478207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327b869094364d0482b667ebcf60b830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:37Z,use_quota=True,user_id='048ff113b55a43eeb532db5e6472f0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Creating volume 3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:46 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:46 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 1073741824 Jul 06 12:13:46 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125f630a-1228-4341-b9f3-31940589ae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409c444e-0f3a-4c03-8e00-cace680476c8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a7b16e-9058-44e9-835c-02c0c8973388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:46 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:46 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Volume volume-409c444e-0f3a-4c03-8e00-cace680476c8 (409c444e-0f3a-4c03-8e00-cace680476c8): created successfully Jul 06 12:13:46 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a7b16e-9058-44e9-835c-02c0c8973388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (274bc876-a63e-4ac2-bb0b-5ef0ec5f2181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-bfc5bb2b-9493-4bf4-8783-99f0c5953dd8 tempest-VolumesActionsTest-2054149800 None] Created volume successfully. Jul 06 12:13:47 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.239s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:47 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c Jul 06 12:13:47 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:47 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 1073741824" returned: 0 in 1.310s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-409c444e-0f3a-4c03-8e00-cace680476c8-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Lock "cinder-409c444e-0f3a-4c03-8e00-cace680476c8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:47 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:13:47 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-quobyte-409c444e-0f3a-4c03-8e00-cace680476c8" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-409c444e-0f3a-4c03-8e00-cace680476c8" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecff258b-6d40-4ab3-9f50-bda926fba86d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:48 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 Jul 06 12:13:48 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:48 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 0 in 0.813s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.518s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1990100153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abe81bd-4a97-4a67-9cac-edb51d10ea87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db6acb8c2854e56a2262aabbeab01ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:44Z,use_quota=True,user_id='3cb7374faf124fd9847419a5578e753b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Creating volume 7abe81bd-4a97-4a67-9cac-edb51d10ea87 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:48 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:48 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 1073741824 Jul 06 12:13:48 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Attempting download of b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume 3d4380c6-e8b9-464b-920b-e03736478207. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:13:48 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" returned: 0 in 1.153s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:48 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c Jul 06 12:13:48 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0f13d-570b-418e-9614-0b84959079fa]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_mc_7n39s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:49 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_mc_7n39s Jul 06 12:13:49 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:49 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8" returned: 0 in 1.170s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:49 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8 Jul 06 12:13:49 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:49 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" returned: 0 in 1.042s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c" released by "_delete_snapshot" :: held 4.873s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" released by "delete_snapshot" :: held 4.909s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Created reservations ['a21aa8cc-e7e6-46f6-927c-ce73e87bea48', 'a3060ec0-b3a9-4852-acfa-c545436a3345', 'a0461dbb-1ce5-428c-9320-e29594c3dc5d', '3ee6db26-d4ff-4738-981d-d0cc3e5dfa3e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:49 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 1073741824" returned: 0 in 1.348s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Delete snapshot completed successfully. Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7a28256e-b473-428e-9d62-e7f27b6f7800 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-f0b4e42e-1f89-46e3-8cb9-624cfdce1b6c-delete_snapshot" released by "delete_snapshot" :: held 5.152s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:50 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 Jul 06 12:13:50 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:50 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-409c444e-0f3a-4c03-8e00-cace680476c8" returned: 0 in 1.230s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-409c444e-0f3a-4c03-8e00-cace680476c8" released by "delete_volume" :: held 2.460s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:50 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_mc_7n39s" returned: 0 in 1.615s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_mc_7n39s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Created reservations ['8e6a79f6-6ead-4d30-ba5d-530122f3d989', '247d75d1-50ea-4254-8a37-8ab2817d9533', '653253bc-42f9-4c27-ac2c-2510860de6ca', '4a7ed1f6-cbac-4ce7-b794-cce13521ea5e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:50 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_mc_7n39s Jul 06 12:13:50 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:50 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:13:50 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:51 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87" returned: 0 in 1.179s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] <== create_volume: return (2605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.609s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.296s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa55cbd-dd26-46a9-b072-ed7ceabf47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37625277-9146-4d3a-b8e2-29909a6df36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Creating offline snapshot 2167f9e6-1f0d-490f-bc58-414301047355 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:13:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Volume volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 (7abe81bd-4a97-4a67-9cac-edb51d10ea87): created successfully Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37625277-9146-4d3a-b8e2-29909a6df36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Flow 'volume_create_manager' (40f35565-e29e-4662-8704-6f30fdfea608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7559c-7c4b-409c-98de-b2c3052f283c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-deadc8a7-5f08-487a-b5a0-8ca734a72591 tempest-ServerRescueNegativeTestJSON-25641452 None] Created volume successfully. Jul 06 12:13:51 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:51 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:51 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.138s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Deleted volume successfully. Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10174ad2-0a6c-40aa-a92f-64f226e632c9 tempest-VolumesActionsTest-200804529 None] Lock "cinder-409c444e-0f3a-4c03-8e00-cace680476c8-delete_volume" released by "delete_volume" :: held 4.139s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:51 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_mc_7n39s" returned: 1 in 1.601s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_mc_7n39s' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff39fb4-47f4-4b7b-9de8-c000a41eefb5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:52 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD Jul 06 12:13:52 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (5535645c-78b2-45fd-bdfb-00f65dfe6089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085cdf65-c757-4ae6-899b-02284ccc23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085cdf65-c757-4ae6-899b-02284ccc23d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2016802891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b073d601-a1e0-480a-a7e2-d4cdb0fe9e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:53Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdcbc7a-7a29-4423-9113-937c9f9e4c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdcbc7a-7a29-4423-9113-937c9f9e4c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d21a5ef-29f4-42fb-a9fd-1ef8f2f0e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d21a5ef-29f4-42fb-a9fd-1ef8f2f0e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b073d601-a1e0-480a-a7e2-d4cdb0fe9e31', 'volume_name': 'volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a3d80c-56db-477c-9e0b-306dc09297b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a3d80c-56db-477c-9e0b-306dc09297b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70877bd3-b3e0-4ce0-a889-4d07820ce386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:52 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Volume b073d601-a1e0-480a-a7e2-d4cdb0fe9e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31', 'volume_size': 1} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:52 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.310s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:52 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 1G Jul 06 12:13:52 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:53 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD" returned: 0 in 1.245s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:53 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] b501de2b-75f2-48fc-a750-711c22cfabf3 was qcow2, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:13:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:53 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:13:53 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:53 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 1G" returned: 0 in 1.180s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:53 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 Jul 06 12:13:53 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:54 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355" returned: 0 in 1.051s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:54 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 is being set with open permissions: ugo+rw Jul 06 12:13:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:55 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 Jul 06 12:13:55 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:55 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 0 in 2.605s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_wx795b6vdevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:13:55 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Converted 112.00 MB image at 42.95 MB/s Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:55 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 1G Jul 06 12:13:55 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:55 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355" returned: 0 in 0.914s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=71,cinder:UPDATE=67,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.738s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.232s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2016802891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b073d601-a1e0-480a-a7e2-d4cdb0fe9e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:53Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Creating volume b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:55 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:13:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:55 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 1073741824 Jul 06 12:13:55 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:55 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b911e1aa-10d4-4712-900c-8c6dcddce895 tempest-SnapshotsActionsTest-375270549 None] Create snapshot completed successfully Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-2167f9e6-1f0d-490f-bc58-414301047355-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-2167f9e6-1f0d-490f-bc58-414301047355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Acquiring lock "cinder-quobyte-2167f9e6-1f0d-490f-bc58-414301047355" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-2167f9e6-1f0d-490f-bc58-414301047355" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Deleting offline snapshot 2167f9e6-1f0d-490f-bc58-414301047355 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] snapshot_file for this snap is: volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851c582-fec5-4436-8738-32ed0b887cb4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:56 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 Jul 06 12:13:56 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:56 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 1G" returned: 0 in 0.904s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e3ca49-b6f8-4c32-9655-2e4bbad61e0f]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:56 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:13:56 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:57 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 1073741824" returned: 0 in 1.114s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:57 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 Jul 06 12:13:57 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:57 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355" returned: 0 in 0.961s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e70321b-936d-4f70-9ea6-e80facb9ef50]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:57 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:13:57 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:57 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 0 in 0.947s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:57 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:13:57 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:57 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31" returned: 0 in 0.756s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70877bd3-b3e0-4ce0-a889-4d07820ce386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedc8e70-d672-4962-a9d3-6c1a57b1c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Volume volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 (b073d601-a1e0-480a-a7e2-d4cdb0fe9e31): created successfully Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedc8e70-d672-4962-a9d3-6c1a57b1c726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (5535645c-78b2-45fd-bdfb-00f65dfe6089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-aebb671e-dd8e-402b-b582-3bbf2654cc08 tempest-VolumesActionsTest-2054149800 None] Created volume successfully. Jul 06 12:13:58 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 0.925s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:58 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 Jul 06 12:13:58 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:58 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 1 in 0.920s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Downloaded image b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume 3d4380c6-e8b9-464b-920b-e03736478207 successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 for user 048ff113b55a43eeb532db5e6472f0b6 is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Marking volume 3d4380c6-e8b9-464b-920b-e03736478207 as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Copying metadata from image b501de2b-75f2-48fc-a750-711c22cfabf3 to 3d4380c6-e8b9-464b-920b-e03736478207. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Creating volume glance metadata for volume 3d4380c6-e8b9-464b-920b-e03736478207 backed by image b501de2b-75f2-48fc-a750-711c22cfabf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c03911-df78-4d3c-8596-31fbad49b605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4380c6-e8b9-464b-920b-e03736478207', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94cb775-1225-498c-8003-bb0f933e7bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:58 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Volume volume-3d4380c6-e8b9-464b-920b-e03736478207 (3d4380c6-e8b9-464b-920b-e03736478207): created successfully Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94cb775-1225-498c-8003-bb0f933e7bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Flow 'volume_create_manager' (c5d290b4-0073-4e4a-b06e-2c9e73b42f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8963e381-81a1-4bb5-988a-580672f19ae4 tempest-TestShelveInstance-1734523983 None] Created volume successfully. Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Lock "cinder-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:59 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355" returned: 0 in 1.012s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:59 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355 Jul 06 12:13:59 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-quobyte-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493ca58-2e4a-492b-a408-f62142702ebc]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:59 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 Jul 06 12:13:59 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:00 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.2167f9e6-1f0d-490f-bc58-414301047355" returned: 0 in 0.764s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-2167f9e6-1f0d-490f-bc58-414301047355" released by "_delete_snapshot" :: held 3.810s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" released by "delete_snapshot" :: held 3.849s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:00 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Created reservations ['9690fd2e-0916-450f-b117-8c5198d470ba', '7cfd2855-cf4e-47ca-a6a8-d6facac7f374', '80d9e101-0ace-42da-88d7-81b32635795c', '829d5525-80c0-4b9b-bfda-2201d80f4a70'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Delete snapshot completed successfully. Jul 06 12:14:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-54424b4a-4d54-457f-b32e-4fabf236fb01 tempest-SnapshotsActionsTest-1601683892 None] Lock "cinder-2167f9e6-1f0d-490f-bc58-414301047355-delete_snapshot" released by "delete_snapshot" :: held 4.067s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:00 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31" returned: 0 in 0.906s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:00 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31 Jul 06 12:14:00 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "cinder-08be8885-b3fc-4e16-9f0b-dbfcd8e68a59-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-08be8885-b3fc-4e16-9f0b-dbfcd8e68a59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "cinder-quobyte-08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-quobyte-08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Deleting offline snapshot 08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 of volume e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] snapshot_file for this snap is: volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e67759-d89a-44ff-ad01-3a85dca434f9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:01 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31" returned: 0 in 1.160s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31" released by "delete_volume" :: held 2.150s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Created reservations ['bc483cbc-3434-46a6-90a8-39bbdd91dba5', '68ea9959-9e1a-452d-a62e-5457275f2c22', 'bb03f5ff-9589-446c-9818-585e154a4cf9', '036a418c-4ca7-4b24-b911-9283b2d8031e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:01 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:14:01 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:01 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:02 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:03 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.615s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:14:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[01628e5d-e0f5-41b3-90a3-524916937f91]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:03 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 Jul 06 12:14:03 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:03 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.904s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:03 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:03 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Deleted volume successfully. Jul 06 12:14:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-564313e6-7568-4aa9-9b6b-cf2472e23aac tempest-VolumesActionsTest-200804529 None] Lock "cinder-b073d601-a1e0-480a-a7e2-d4cdb0fe9e31-delete_volume" released by "delete_volume" :: held 4.645s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (4e822bb7-4d22-432a-a9ee-1225bf2bce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8c2423-4a24-4256-a99d-1c58ea7c6aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8c2423-4a24-4256-a99d-1c58ea7c6aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-729240871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a709d8-0520-4a85-8bb6-6d241c153ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:04Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3679dfde-d027-4d0e-8763-3aa45180b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3679dfde-d027-4d0e-8763-3aa45180b973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4659a4-ee38-4d76-b04e-4d29659d6c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4659a4-ee38-4d76-b04e-4d29659d6c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a709d8-0520-4a85-8bb6-6d241c153ab2', 'volume_name': 'volume-61a709d8-0520-4a85-8bb6-6d241c153ab2', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f294f024-0205-4471-97c1-0e79d424ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f294f024-0205-4471-97c1-0e79d424ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7278624-5e72-4fc6-81c5-d241c28727f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Volume 61a709d8-0520-4a85-8bb6-6d241c153ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a709d8-0520-4a85-8bb6-6d241c153ab2', 'volume_size': 1} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-729240871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a709d8-0520-4a85-8bb6-6d241c153ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:04Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Creating volume 61a709d8-0520-4a85-8bb6-6d241c153ab2 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:04 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:04 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 1073741824 Jul 06 12:14:04 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:04 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" returned: 0 in 1.792s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:04 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:14:04 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:05 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 1073741824" returned: 0 in 1.233s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:05 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 Jul 06 12:14:05 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:06 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.133s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:06 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59 Jul 06 12:14:06 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:06 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2" returned: 0 in 1.172s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] <== create_volume: return (2503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.505s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=72,cinder:UPDATE=87,cinder:DELETE=6,cinder:INSERT=25 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7278624-5e72-4fc6-81c5-d241c28727f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a709d8-0520-4a85-8bb6-6d241c153ab2', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225f4fa0-3bc9-4a9b-88ae-03458dadeb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:06 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Volume volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 (61a709d8-0520-4a85-8bb6-6d241c153ab2): created successfully Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225f4fa0-3bc9-4a9b-88ae-03458dadeb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (4e822bb7-4d22-432a-a9ee-1225bf2bce1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-69880cc3-f504-47b4-a927-5efa26cdbc53 tempest-VolumesActionsTest-2054149800 None] Created volume successfully. Jul 06 12:14:07 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8.08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" returned: 0 in 1.052s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-quobyte-08be8885-b3fc-4e16-9f0b-dbfcd8e68a59" released by "_delete_snapshot" :: held 5.782s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" released by "delete_snapshot" :: held 5.826s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Created reservations ['c4888d46-19ac-4fc7-9144-938ce9b5156e', '5c66d633-fa59-4975-9b8b-a2b210bdd904', '0589284e-1138-4b02-9870-66306ce374b4', '4b0668c4-e552-43e2-99f6-28de42e1574f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Delete snapshot completed successfully. Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2a6e20ed-5266-47e1-823f-9e1393ecbf43 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-08be8885-b3fc-4e16-9f0b-dbfcd8e68a59-delete_snapshot" released by "delete_snapshot" :: held 6.103s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-61a709d8-0520-4a85-8bb6-6d241c153ab2-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Lock "cinder-61a709d8-0520-4a85-8bb6-6d241c153ab2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Acquiring lock "cinder-quobyte-61a709d8-0520-4a85-8bb6-6d241c153ab2" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-61a709d8-0520-4a85-8bb6-6d241c153ab2" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefd28f-94ce-4a8b-b65b-41fcbc03fa02]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:08 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "cinder-e57b767d-e8eb-4772-a6a5-09565c4c9ce8-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:08 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-e57b767d-e8eb-4772-a6a5-09565c4c9ce8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd3653-45b8-4ed4-9130-d04b3b746b59]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:08 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 Jul 06 12:14:08 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a75bdbe-95d1-4822-8fb3-73d06493bef5]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:09 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:14:09 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:09 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2" returned: 0 in 1.368s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:09 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2 Jul 06 12:14:09 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:09 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" returned: 0 in 1.281s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:09 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8 Jul 06 12:14:09 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:10 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-61a709d8-0520-4a85-8bb6-6d241c153ab2" returned: 0 in 1.177s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:10 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Lock "cinder-quobyte-61a709d8-0520-4a85-8bb6-6d241c153ab2" released by "delete_volume" :: held 2.659s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 0 in 1.619s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Created reservations ['c80281e6-30d1-47e0-94e9-d143aba046dc', '4fb9a096-b931-4204-89a7-18c013940a7f', '1469c7ca-3a31-44d9-98d4-2dab6d8890b6', '6cbbd6dd-a190-428b-b26c-6525ec6b4ac9'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:10 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:14:10 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:10 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:10 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:11 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" returned: 0 in 1.479s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-quobyte-e57b767d-e8eb-4772-a6a5-09565c4c9ce8" released by "delete_volume" :: held 2.864s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Created reservations ['4d047403-268c-4d3f-b598-37392d4331f3', '1cef4e16-89d5-426d-9d55-7d55fe3ca9e8', '9226f406-5d6d-4a18-8253-e95b5f42ef57', 'c2c36f60-0062-4f36-a73b-622bb64dd796'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:11 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:11 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:12 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.589s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Deleted volume successfully. Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ced0e0c2-2243-47c1-b6f8-3deee39dee3a tempest-VolumesActionsTest-200804529 None] Lock "cinder-61a709d8-0520-4a85-8bb6-6d241c153ab2-delete_volume" released by "delete_volume" :: held 4.817s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:12 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 1 in 2.213s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.880s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Acquiring lock "cinder-7abe81bd-4a97-4a67-9cac-edb51d10ea87-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-3d4380c6-e8b9-464b-920b-e03736478207', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b851a3e-c26f-42d4-9fe0-347f8b848607', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "cinder-7abe81bd-4a97-4a67-9cac-edb51d10ea87-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:12 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (1ce8c407-bfc5-414c-b823-5cd84f62b173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dc7e0f-08b2-42c0-bd41-2bc48a468a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dc7e0f-08b2-42c0-bd41-2bc48a468a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064447470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2431c5d0-60e1-4b98-8b5f-5c3426a66106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:13Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2e4fdb-1b5d-46c3-a9ea-56a29c7cb1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2e4fdb-1b5d-46c3-a9ea-56a29c7cb1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5265e1-ce8e-4209-911a-b6d28e4bf674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5265e1-ce8e-4209-911a-b6d28e4bf674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2431c5d0-60e1-4b98-8b5f-5c3426a66106', 'volume_name': 'volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4d30ff-35a5-4586-8832-f48e97fd4ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4d30ff-35a5-4586-8832-f48e97fd4ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8c2a26-c454-47a8-a928-062313ab5d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:13 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Volume 2431c5d0-60e1-4b98-8b5f-5c3426a66106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106', 'volume_size': 1} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064447470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2431c5d0-60e1-4b98-8b5f-5c3426a66106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db947d00f9a4f5bb4c194d3d126032c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:13Z,use_quota=True,user_id='de8e0d5b05bf4934bbfa44e558fac7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Creating volume 2431c5d0-60e1-4b98-8b5f-5c3426a66106 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:13 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Acquiring lock "cinder-quobyte-7abe81bd-4a97-4a67-9cac-edb51d10ea87" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:13 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 1073741824 Jul 06 12:14:13 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:13 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.458s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "cinder-quobyte-7abe81bd-4a97-4a67-9cac-edb51d10ea87" acquired by "delete_volume" :: waited 0.054s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Deleted volume successfully. Jul 06 12:14:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-41ed5b12-0faa-4b61-a004-791328f4cff3 req-fec0c21a-734e-46e4-a2dd-8a8bb5d32383 tempest-TestShelveInstance-1734523983 None] attachment_update completed successfully. Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33d20b5-6b88-414b-b33e-0e877dcc44e4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-95e8d5de-9f69-48d4-a1b0-c6789f444159 tempest-SnapshotsActionsTest-375270549 None] Lock "cinder-e57b767d-e8eb-4772-a6a5-09565c4c9ce8-delete_volume" released by "delete_volume" :: held 5.145s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:13 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 Jul 06 12:14:13 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:14 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 1073741824" returned: 0 in 1.607s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:14 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 Jul 06 12:14:14 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:15 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87" returned: 0 in 1.792s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:15 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87 Jul 06 12:14:15 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:16 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7abe81bd-4a97-4a67-9cac-edb51d10ea87" returned: 0 in 1.146s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "cinder-quobyte-7abe81bd-4a97-4a67-9cac-edb51d10ea87" released by "delete_volume" :: held 3.036s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:16 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106" returned: 0 in 1.490s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] <== create_volume: return (3239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.241s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Created reservations ['1ea30627-38cf-4ae2-9acc-b079ae3e100f', 'b7628743-1c1c-4ad1-8173-3d9645176b6c', '5bd64b35-abf9-4c2b-a8ef-74640212a3b4', '92484788-1baf-42d5-a1f1-fc1bf0c11fb5'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8c2a26-c454-47a8-a928-062313ab5d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5668683f-45e2-4564-b7f7-45faebc7539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:16 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Volume volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 (2431c5d0-60e1-4b98-8b5f-5c3426a66106): created successfully Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5668683f-45e2-4564-b7f7-45faebc7539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Flow 'volume_create_manager' (1ce8c407-bfc5-414c-b823-5cd84f62b173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:16 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-aa23de56-e17d-4327-8607-ed80c3706838 tempest-VolumesActionsTest-2054149800 None] Created volume successfully. Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:16 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:16 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:18 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.771s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:18 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Deleted volume successfully. Jul 06 12:14:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad775204-7fec-4a43-a4ab-11d077ebbc1a tempest-ServerRescueNegativeTestJSON-25641452 None] Lock "cinder-7abe81bd-4a97-4a67-9cac-edb51d10ea87-delete_volume" released by "delete_volume" :: held 5.527s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "cinder-2431c5d0-60e1-4b98-8b5f-5c3426a66106-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Lock "cinder-2431c5d0-60e1-4b98-8b5f-5c3426a66106-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "cinder-quobyte-2431c5d0-60e1-4b98-8b5f-5c3426a66106" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Lock "cinder-quobyte-2431c5d0-60e1-4b98-8b5f-5c3426a66106" acquired by "delete_volume" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:19 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed90e2-5f7f-499e-b837-0a99fd55747e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:19 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 Jul 06 12:14:19 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:21 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106" returned: 0 in 1.972s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:21 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106 Jul 06 12:14:21 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:22 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2431c5d0-60e1-4b98-8b5f-5c3426a66106" returned: 0 in 1.534s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Lock "cinder-quobyte-2431c5d0-60e1-4b98-8b5f-5c3426a66106" released by "delete_volume" :: held 3.643s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Created reservations ['56341134-8d0d-4157-979e-f6a51098ec8f', 'c67fa8c0-ac19-44e3-a596-05f37d0cdd98', '9f907ae6-9b33-4a63-8f0c-83d9a64f5ea0', '03d7e5ae-b7a8-4feb-82d9-45914d5a8490'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:23 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:23 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:24 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.593s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:24 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:24 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Deleted volume successfully. Jul 06 12:14:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-79f9140f-d34d-4a6f-b8f6-a781eec80307 tempest-VolumesActionsTest-2054149800 None] Lock "cinder-2431c5d0-60e1-4b98-8b5f-5c3426a66106-delete_volume" released by "delete_volume" :: held 5.780s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:14:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:27 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:27 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:28 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.283s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:14:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:14:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:14:33 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=59,cinder:DELETE=3,cinder:SELECT=54,cinder:INSERT=18 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:34 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:DELETE=6,cinder:SELECT=29,cinder:INSERT=11,cinder:UPDATE=45 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Flow 'volume_create_manager' (336a6882-225a-474b-85eb-9443be15c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49d92ec-fca4-4a03-948f-9c30ac4733f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49d92ec-fca4-4a03-948f-9c30ac4733f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1084302216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6293d1c9-8151-476d-88b3-d720a795002c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4ca955e1ad4507bdc6321dccbd239f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:37Z,use_quota=True,user_id='6647473435734d20afb4b3293c670be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32371998-f8d0-4fc0-8f88-6fa6d9426542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32371998-f8d0-4fc0-8f88-6fa6d9426542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1825d51f-b9e3-4e58-b468-1a9469a25830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1825d51f-b9e3-4e58-b468-1a9469a25830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6293d1c9-8151-476d-88b3-d720a795002c', 'volume_name': 'volume-6293d1c9-8151-476d-88b3-d720a795002c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c44179-e860-46fe-971b-a1c0b2127f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c44179-e860-46fe-971b-a1c0b2127f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4446e56-5840-4dbb-a182-3e8d3bdaf86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Volume 6293d1c9-8151-476d-88b3-d720a795002c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6293d1c9-8151-476d-88b3-d720a795002c', 'volume_size': 1} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1084302216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6293d1c9-8151-476d-88b3-d720a795002c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4ca955e1ad4507bdc6321dccbd239f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:37Z,use_quota=True,user_id='6647473435734d20afb4b3293c670be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Creating volume 6293d1c9-8151-476d-88b3-d720a795002c {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:36 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:36 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c 1073741824 Jul 06 12:14:36 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c 1073741824" returned: 0 in 1.435s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:38 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:38 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c Jul 06 12:14:38 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:39 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c" returned: 0 in 1.048s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] <== create_volume: return (2587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.595s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4446e56-5840-4dbb-a182-3e8d3bdaf86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6293d1c9-8151-476d-88b3-d720a795002c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b78607-9be4-43b6-bbe8-e68fb8304fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:39 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Volume volume-6293d1c9-8151-476d-88b3-d720a795002c (6293d1c9-8151-476d-88b3-d720a795002c): created successfully Jul 06 12:14:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b78607-9be4-43b6-bbe8-e68fb8304fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Flow 'volume_create_manager' (336a6882-225a-474b-85eb-9443be15c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8f7e5c52-734c-4fcb-a550-a0fe77054d61 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Created volume successfully. Jul 06 12:14:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Acquiring lock "cinder-6293d1c9-8151-476d-88b3-d720a795002c-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "cinder-6293d1c9-8151-476d-88b3-d720a795002c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Acquiring lock "cinder-quobyte-6293d1c9-8151-476d-88b3-d720a795002c" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "cinder-quobyte-6293d1c9-8151-476d-88b3-d720a795002c" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd395cbe-12c7-4f03-9d56-dcfa8d625655]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:42 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c Jul 06 12:14:42 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:43 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c" returned: 0 in 0.978s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:43 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c Jul 06 12:14:43 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:43 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6293d1c9-8151-476d-88b3-d720a795002c" returned: 0 in 0.825s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "cinder-quobyte-6293d1c9-8151-476d-88b3-d720a795002c" released by "delete_volume" :: held 1.855s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Created reservations ['11a24991-f189-41c9-b845-05e8a0978887', '20f57126-5e3f-4c7f-908f-dbe11bfbb409', 'de716067-1f56-437a-bcb8-f8f5a2d65646', 'aa2c392f-8eb9-4f43-90de-89cb66666d4a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:44 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:44 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:45 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.896s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Deleted volume successfully. Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d149833d-77f8-4e90-9a6a-501be89e6b63 tempest-VolumeQuotasNegativeTestJSON-433796624 None] Lock "cinder-6293d1c9-8151-476d-88b3-d720a795002c-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Flow 'volume_create_manager' (1c22149c-3186-42c3-9569-9780d05abe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a557872-44b9-49a3-bd36-b86f2bdadaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a557872-44b9-49a3-bd36-b86f2bdadaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-95641201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c638f70942cf47abae8956101174cf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:45Z,use_quota=True,user_id='1010ccc520364fceb5dc8472039c2c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b48c6b9-0fb4-49a4-89d5-b3ff5e216887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b48c6b9-0fb4-49a4-89d5-b3ff5e216887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d53a10-3705-469c-b273-62f198a3247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d53a10-3705-469c-b273-62f198a3247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623', 'volume_name': 'volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b19923a-a98f-476d-8d14-2e43819dc5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b19923a-a98f-476d-8d14-2e43819dc5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbe3f1b-243e-4b63-adb3-96f1071d7e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:45 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Volume c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623', 'volume_size': 1} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-95641201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c638f70942cf47abae8956101174cf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:45Z,use_quota=True,user_id='1010ccc520364fceb5dc8472039c2c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Creating volume c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:45 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:45 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 1073741824 Jul 06 12:14:45 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:46 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 1073741824" returned: 0 in 1.235s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:46 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 Jul 06 12:14:46 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:48 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623" returned: 0 in 1.173s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] <== create_volume: return (2488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.491s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbe3f1b-243e-4b63-adb3-96f1071d7e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546074a9-d102-426f-a02e-4bf0522abae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:48 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Volume volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 (c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623): created successfully Jul 06 12:14:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546074a9-d102-426f-a02e-4bf0522abae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Flow 'volume_create_manager' (1c22149c-3186-42c3-9569-9780d05abe67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-161667ff-fb92-4c63-a16c-e839fe85ba60 tempest-VolumesListAdminTestJSON-1441275373 None] Created volume successfully. Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Flow 'volume_create_manager' (2aeb504b-dcee-48c5-a43d-88ad26523848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e3dabe-0a46-40f1-9870-f460fdd60284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e3dabe-0a46-40f1-9870-f460fdd60284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-458627634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea77413-38a2-475e-9457-d58388c0f70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c638f70942cf47abae8956101174cf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:49Z,use_quota=True,user_id='1010ccc520364fceb5dc8472039c2c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7b597-1c98-4bec-bee2-a2e736bb3398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7b597-1c98-4bec-bee2-a2e736bb3398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79fcaa-78cc-48fe-bce1-48991d205690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79fcaa-78cc-48fe-bce1-48991d205690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea77413-38a2-475e-9457-d58388c0f70a', 'volume_name': 'volume-3ea77413-38a2-475e-9457-d58388c0f70a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facc80a4-4ffc-4b9d-bfc1-7da43eeb18f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facc80a4-4ffc-4b9d-bfc1-7da43eeb18f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09c3437-72aa-4eb1-aba2-1ee7f890bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:49 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Volume 3ea77413-38a2-475e-9457-d58388c0f70a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea77413-38a2-475e-9457-d58388c0f70a', 'volume_size': 1} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-458627634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea77413-38a2-475e-9457-d58388c0f70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c638f70942cf47abae8956101174cf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:49Z,use_quota=True,user_id='1010ccc520364fceb5dc8472039c2c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Creating volume 3ea77413-38a2-475e-9457-d58388c0f70a {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:49 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:49 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a 1073741824 Jul 06 12:14:49 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:50 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a 1073741824" returned: 0 in 1.205s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:51 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a Jul 06 12:14:51 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:51 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a" returned: 0 in 0.770s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c09c3437-72aa-4eb1-aba2-1ee7f890bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea77413-38a2-475e-9457-d58388c0f70a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbc39ce-8ac2-4566-8ea8-154aba00de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Volume volume-3ea77413-38a2-475e-9457-d58388c0f70a (3ea77413-38a2-475e-9457-d58388c0f70a): created successfully Jul 06 12:14:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbc39ce-8ac2-4566-8ea8-154aba00de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Flow 'volume_create_manager' (2aeb504b-dcee-48c5-a43d-88ad26523848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6d969eb9-25f9-4511-95f8-8ab2ab522d05 tempest-VolumesListAdminTestJSON-1441275373 None] Created volume successfully. Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Flow 'volume_create_manager' (b5c78005-8a66-4e50-bbb7-87bd9e744c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0072d424-9ac5-4c2a-93f6-20180db6b1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0072d424-9ac5-4c2a-93f6-20180db6b1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1648490515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f27a7d-9281-43ae-9669-dcad22f8f86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bb14c6b2084ce783e6d7b5d030debc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:52Z,use_quota=True,user_id='37a63d2ca8b64aaf871d5ca14fe3d081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1d47e68-b0e4-486a-bb29-809b921d102f),volume_type_id=a1d47e68-b0e4-486a-bb29-809b921d102f)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5322ffa7-1a91-4526-aadb-f5865b2ac1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5322ffa7-1a91-4526-aadb-f5865b2ac1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866313b5-b616-414f-8038-5720248f0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866313b5-b616-414f-8038-5720248f0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f27a7d-9281-43ae-9669-dcad22f8f86e', 'volume_name': 'volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c455328-682a-4173-a604-fcb30aa0f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c455328-682a-4173-a604-fcb30aa0f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa2f480-be6a-40d8-8983-1e67f3b606a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:52 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Volume d1f27a7d-9281-43ae-9669-dcad22f8f86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e', 'volume_size': 1} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1648490515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f27a7d-9281-43ae-9669-dcad22f8f86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bb14c6b2084ce783e6d7b5d030debc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:52Z,use_quota=True,user_id='37a63d2ca8b64aaf871d5ca14fe3d081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1d47e68-b0e4-486a-bb29-809b921d102f),volume_type_id=a1d47e68-b0e4-486a-bb29-809b921d102f)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Creating volume d1f27a7d-9281-43ae-9669-dcad22f8f86e {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:52 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:52 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e 1073741824 Jul 06 12:14:52 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Flow 'volume_create_manager' (f641211a-8650-41f6-8417-aa3ab5b57281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5815c2-69de-49b6-890c-a2ba5f0b1ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5815c2-69de-49b6-890c-a2ba5f0b1ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1036639510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c656e4-fc5e-441b-8b40-86b2177d6824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c638f70942cf47abae8956101174cf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:53Z,use_quota=True,user_id='1010ccc520364fceb5dc8472039c2c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7050c687-dddc-4ade-ba7f-5ff282b411f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7050c687-dddc-4ade-ba7f-5ff282b411f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8301d4-32af-41ab-8d6d-f849abd7fbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8301d4-32af-41ab-8d6d-f849abd7fbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c656e4-fc5e-441b-8b40-86b2177d6824', 'volume_name': 'volume-20c656e4-fc5e-441b-8b40-86b2177d6824', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa50c761-22af-4f95-afe6-48b18c874682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa50c761-22af-4f95-afe6-48b18c874682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cfaba1-d3c3-4f91-8a79-a9d44a8b5914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:53 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Volume 20c656e4-fc5e-441b-8b40-86b2177d6824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c656e4-fc5e-441b-8b40-86b2177d6824', 'volume_size': 1} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:53 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e 1073741824" returned: 0 in 1.257s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:53 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e Jul 06 12:14:53 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:54 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e" returned: 0 in 0.749s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.909s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1036639510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c656e4-fc5e-441b-8b40-86b2177d6824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c638f70942cf47abae8956101174cf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:53Z,use_quota=True,user_id='1010ccc520364fceb5dc8472039c2c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Creating volume 20c656e4-fc5e-441b-8b40-86b2177d6824 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:54 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:54 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 1073741824 Jul 06 12:14:54 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa2f480-be6a-40d8-8983-1e67f3b606a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ca0244-050c-4818-844a-811301af0256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:54 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Volume volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e (d1f27a7d-9281-43ae-9669-dcad22f8f86e): created successfully Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ca0244-050c-4818-844a-811301af0256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Flow 'volume_create_manager' (b5c78005-8a66-4e50-bbb7-87bd9e744c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:54 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5dd086de-c060-49f5-892f-7280df27f639 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Created volume successfully. Jul 06 12:14:55 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 1073741824" returned: 0 in 1.175s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:55 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 Jul 06 12:14:55 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:56 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:14:56 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:56 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824" returned: 0 in 0.880s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cfaba1-d3c3-4f91-8a79-a9d44a8b5914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c656e4-fc5e-441b-8b40-86b2177d6824', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76829f4c-bee4-498d-8eb2-ca748bbf53d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Volume volume-20c656e4-fc5e-441b-8b40-86b2177d6824 (20c656e4-fc5e-441b-8b40-86b2177d6824): created successfully Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76829f4c-bee4-498d-8eb2-ca748bbf53d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Flow 'volume_create_manager' (f641211a-8650-41f6-8417-aa3ab5b57281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9faf7421-27ac-41f4-a4d4-a95bcc627af9 tempest-VolumesListAdminTestJSON-1441275373 None] Created volume successfully. Jul 06 12:14:57 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.980s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-144b0968-30f4-4a73-ae29-017ad6ff0eb4 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Retype volume completed successfully. Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Acquiring lock "cinder-d1f27a7d-9281-43ae-9669-dcad22f8f86e-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "cinder-d1f27a7d-9281-43ae-9669-dcad22f8f86e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Acquiring lock "cinder-quobyte-d1f27a7d-9281-43ae-9669-dcad22f8f86e" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "cinder-quobyte-d1f27a7d-9281-43ae-9669-dcad22f8f86e" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aaccd3-6760-46e6-b0cc-b786de45b9c0]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:57 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e Jul 06 12:14:57 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:58 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e" returned: 0 in 1.131s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:58 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e Jul 06 12:14:58 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Flow 'volume_create_manager' (a7b490ad-0714-437a-aaa0-138748103291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54541fbe-3c66-45c9-aab5-2ff76bb5464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54541fbe-3c66-45c9-aab5-2ff76bb5464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ddf2af-3ac2-4bf7-9a5f-5da02866c573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74295e1c6204d10b0ff487eeecb4b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:59Z,use_quota=True,user_id='e3297ce889f345699350866a4648e512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e326293c-2016-4f49-8fb5-52d54fa2c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e326293c-2016-4f49-8fb5-52d54fa2c210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02c2316-270a-4415-abc3-60f8ff25f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02c2316-270a-4415-abc3-60f8ff25f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ddf2af-3ac2-4bf7-9a5f-5da02866c573', 'volume_name': 'volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feaab4c9-4c9b-4157-a24f-e853826fb266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feaab4c9-4c9b-4157-a24f-e853826fb266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078fd946-f7a1-43f6-bb65-b17410a3ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:59 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Volume 27ddf2af-3ac2-4bf7-9a5f-5da02866c573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573', 'volume_size': 1} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ddf2af-3ac2-4bf7-9a5f-5da02866c573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74295e1c6204d10b0ff487eeecb4b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:59Z,use_quota=True,user_id='e3297ce889f345699350866a4648e512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Creating volume 27ddf2af-3ac2-4bf7-9a5f-5da02866c573 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:59 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-6836562d-176e-40c3-8e4d-b484f058d684 req-ca443000-fd04-4aec-bab2-b2ded098c13e tempest-TestShelveInstance-1734523983 None] Terminate volume connection completed successfully. Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-6836562d-176e-40c3-8e4d-b484f058d684 req-ca443000-fd04-4aec-bab2-b2ded098c13e tempest-TestShelveInstance-1734523983 None] Deleting attachment 8b851a3e-c26f-42d4-9fe0-347f8b848607. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:14:59 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 1073741824 Jul 06 12:14:59 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:59 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d1f27a7d-9281-43ae-9669-dcad22f8f86e" returned: 0 in 0.942s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "cinder-quobyte-d1f27a7d-9281-43ae-9669-dcad22f8f86e" released by "delete_volume" :: held 2.143s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:59 devstack cinder-volume[86706]: WARNING cinder.quota [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:14:59 devstack cinder-volume[86706]: WARNING cinder.quota [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:14:59 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Created reservations ['28ec8855-0531-4aef-a300-b1fdb869df3f', 'a97420d1-f6a5-4741-927d-f6a867f48aa2', '2f463a1b-ee3c-417b-be47-fe7fe3951de6', '20fe76ea-748c-4676-b8f9-e9b172f543bb'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:00 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:00 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:00 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 1073741824" returned: 0 in 1.591s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:00 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 Jul 06 12:15:00 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:01 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.063s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Deleted volume successfully. Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18446618-e1d1-43a8-9d07-8fbc219e38b1 tempest-VolumeRetypeWithoutMigrationTest-1533429149 None] Lock "cinder-d1f27a7d-9281-43ae-9669-dcad22f8f86e-delete_volume" released by "delete_volume" :: held 3.710s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:01 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573" returned: 0 in 0.946s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] <== create_volume: return (2594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.597s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078fd946-f7a1-43f6-bb65-b17410a3ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c99581a-3e9f-426f-a61f-5252e44becf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:01 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Volume volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 (27ddf2af-3ac2-4bf7-9a5f-5da02866c573): created successfully Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c99581a-3e9f-426f-a61f-5252e44becf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Flow 'volume_create_manager' (a7b490ad-0714-437a-aaa0-138748103291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e7d96889-d655-471b-a43f-0c8b59adc9df tempest-VolumesListAdminTestJSON-495072397 None] Created volume successfully. Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Acquiring lock "cinder-27ddf2af-3ac2-4bf7-9a5f-5da02866c573-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Lock "cinder-27ddf2af-3ac2-4bf7-9a5f-5da02866c573-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Acquiring lock "cinder-quobyte-27ddf2af-3ac2-4bf7-9a5f-5da02866c573" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Lock "cinder-quobyte-27ddf2af-3ac2-4bf7-9a5f-5da02866c573" acquired by "delete_volume" :: waited 0.055s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae48b8-846d-4710-b35d-47d11c2d5bac]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "cinder-20c656e4-fc5e-441b-8b40-86b2177d6824-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-20c656e4-fc5e-441b-8b40-86b2177d6824-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "cinder-quobyte-20c656e4-fc5e-441b-8b40-86b2177d6824" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-quobyte-20c656e4-fc5e-441b-8b40-86b2177d6824" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f5c1b9-d1cc-4800-8caa-0df3cf9395ea]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:03 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 Jul 06 12:15:03 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:03 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 Jul 06 12:15:03 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:04 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573" returned: 0 in 1.608s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:04 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573 Jul 06 12:15:04 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:04 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824" returned: 0 in 1.497s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:04 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824 Jul 06 12:15:04 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:05 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-27ddf2af-3ac2-4bf7-9a5f-5da02866c573" returned: 0 in 1.112s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Lock "cinder-quobyte-27ddf2af-3ac2-4bf7-9a5f-5da02866c573" released by "delete_volume" :: held 2.792s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:05 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Created reservations ['c01cd246-50c6-4359-9f71-fd3ace5a776d', '6b9cdb3e-20f4-4be6-b5da-e58f5e064d87', '2036c8c6-40fc-4085-b307-f65668adc8cb', '27229ebc-0499-40ca-aa0b-2a8e3d5259f9'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-20c656e4-fc5e-441b-8b40-86b2177d6824" returned: 0 in 1.085s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-quobyte-20c656e4-fc5e-441b-8b40-86b2177d6824" released by "delete_volume" :: held 2.660s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Created reservations ['baf0fbb6-508e-41b5-ab8a-61819dab7819', '4c2196a8-f667-4da8-a234-16910756105d', '14d80fdb-4293-44ab-9d48-da089f7951d3', 'f3d7cf92-1503-42f1-9877-243062de50bf'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:05 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:05 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:06 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:06 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "cinder-3ea77413-38a2-475e-9457-d58388c0f70a-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-3ea77413-38a2-475e-9457-d58388c0f70a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "cinder-quobyte-3ea77413-38a2-475e-9457-d58388c0f70a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-quobyte-3ea77413-38a2-475e-9457-d58388c0f70a" acquired by "delete_volume" :: waited 0.039s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac60d6-5356-4585-8185-11251ce42cb4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:07 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a Jul 06 12:15:07 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:07 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.319s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Deleted volume successfully. Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-138ce1e0-4feb-4b0c-8a14-141d1ab4aed4 tempest-VolumesListAdminTestJSON-495072397 None] Lock "cinder-27ddf2af-3ac2-4bf7-9a5f-5da02866c573-delete_volume" released by "delete_volume" :: held 4.591s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b810f-2295-4b1c-987a-dca89ff910c3]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:07 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.358s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Deleted volume successfully. Jul 06 12:15:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09c8c26a-7d08-42f4-99b7-c25ddfb08187 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-20c656e4-fc5e-441b-8b40-86b2177d6824-delete_volume" released by "delete_volume" :: held 4.635s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:07 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:15:07 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:08 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a" returned: 0 in 1.215s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:08 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a Jul 06 12:15:08 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:08 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 0 in 1.197s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:08 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:15:08 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:08 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea77413-38a2-475e-9457-d58388c0f70a" returned: 0 in 0.911s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-quobyte-3ea77413-38a2-475e-9457-d58388c0f70a" released by "delete_volume" :: held 2.232s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Created reservations ['34fa0ef1-3287-4b78-a8c6-24094eb673ef', '7c2350e1-1a3c-4bfc-bd72-4df3525159a6', '84c49afa-a705-4eae-be3d-b3eea2694b0e', '6c94b886-802f-445e-b153-ae33b2ca3851'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:09 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:09 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:09 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 1 in 1.028s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.317s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-3d4380c6-e8b9-464b-920b-e03736478207', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbb177ca-89f2-401d-adc6-909b21d48fd6', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:15:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-2840849f-2b4d-4c0e-83b1-4585c8394ce9 req-a0a668a1-5ef0-4869-bd01-06f9409fdc73 tempest-TestShelveInstance-1734523983 None] attachment_update completed successfully. Jul 06 12:15:10 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.969s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:10 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Deleted volume successfully. Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88311354-9a18-4482-b9f3-79da00d220b1 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-3ea77413-38a2-475e-9457-d58388c0f70a-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "cinder-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "cinder-quobyte-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-quobyte-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcba2b9-b9a4-41f6-8cb0-95f538268fcf]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Flow 'volume_create_manager' (76f0c589-e6b2-4841-a592-0f507e9fa804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b6fb26-4228-46e1-a531-b8adc0aefb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b6fb26-4228-46e1-a531-b8adc0aefb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664860692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d188ba2-7125-47ba-b8d8-05a3d011e862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c7971b2d904078bf9a202df4488d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:11Z,use_quota=True,user_id='6bc3eb282a054a1a99f737a00fdb98f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cccb86-048a-43f9-9b8f-f9fbe706d199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cccb86-048a-43f9-9b8f-f9fbe706d199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bf0ad9-7516-473d-adad-3cc253debf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bf0ad9-7516-473d-adad-3cc253debf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d188ba2-7125-47ba-b8d8-05a3d011e862', 'volume_name': 'volume-4d188ba2-7125-47ba-b8d8-05a3d011e862', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:10 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 Jul 06 12:15:10 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bbdfbf-5da3-4a05-b590-da168dc6c713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bbdfbf-5da3-4a05-b590-da168dc6c713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060d486d-9b9b-4805-aee7-eca15328925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:10 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Volume 4d188ba2-7125-47ba-b8d8-05a3d011e862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d188ba2-7125-47ba-b8d8-05a3d011e862', 'volume_size': 1} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664860692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d188ba2-7125-47ba-b8d8-05a3d011e862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c7971b2d904078bf9a202df4488d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:11Z,use_quota=True,user_id='6bc3eb282a054a1a99f737a00fdb98f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Creating volume 4d188ba2-7125-47ba-b8d8-05a3d011e862 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:10 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:15:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:10 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 1073741824 Jul 06 12:15:10 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:11 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623" returned: 0 in 1.190s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:11 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623 Jul 06 12:15:11 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:12 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 1073741824" returned: 0 in 1.326s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:12 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 Jul 06 12:15:12 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:12 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623" returned: 0 in 0.918s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-quobyte-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623" released by "delete_volume" :: held 2.208s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Created reservations ['b6bce768-b8d7-4fa8-8b4b-91700872a1b2', '02bcf31f-560f-436e-a3e2-ac72501fb048', '381e83f0-da55-4511-9f7f-13509ca20c9f', '0f14a332-8a29-486b-ae9c-bfc255db1cd6'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:12 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:13 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:13 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862" returned: 0 in 0.950s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060d486d-9b9b-4805-aee7-eca15328925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d188ba2-7125-47ba-b8d8-05a3d011e862', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd2dbaf-2c6e-4ac7-ab66-cf0eedaebc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:13 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Volume volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 (4d188ba2-7125-47ba-b8d8-05a3d011e862): created successfully Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd2dbaf-2c6e-4ac7-ab66-cf0eedaebc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Flow 'volume_create_manager' (76f0c589-e6b2-4841-a592-0f507e9fa804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a20967d1-7bb4-49a9-9518-7adcf5dd5cac tempest-VolumesServicesTestJSON-714989074 None] Created volume successfully. Jul 06 12:15:13 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.725s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Deleted volume successfully. Jul 06 12:15:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0f0a41e5-9c44-450f-85ff-36fbdc7f1928 tempest-VolumesListAdminTestJSON-1441275373 None] Lock "cinder-c4f4a93a-4fdd-42e1-8dba-4a3bd4c6b623-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Acquiring lock "cinder-4d188ba2-7125-47ba-b8d8-05a3d011e862-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Lock "cinder-4d188ba2-7125-47ba-b8d8-05a3d011e862-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Acquiring lock "cinder-quobyte-4d188ba2-7125-47ba-b8d8-05a3d011e862" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Lock "cinder-quobyte-4d188ba2-7125-47ba-b8d8-05a3d011e862" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60e63ad-bb92-4852-b31e-23b2775830fa]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:14 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 Jul 06 12:15:14 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862" returned: 0 in 0.946s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:15 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:15 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862 Jul 06 12:15:15 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:16 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4d188ba2-7125-47ba-b8d8-05a3d011e862" returned: 0 in 0.869s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Lock "cinder-quobyte-4d188ba2-7125-47ba-b8d8-05a3d011e862" released by "delete_volume" :: held 1.893s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Created reservations ['8171a4c9-ad05-48a9-800f-f1184a45617a', '2b0a6d68-3786-4a17-aaeb-55d5f60503aa', '5f6dd75f-4432-4eb5-a5ab-75d843ac4e06', '7679d02a-d6aa-4dcb-b70e-a99bc981a66b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:16 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:16 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:17 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.173s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:17 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Deleted volume successfully. Jul 06 12:15:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f4e5435-837a-492f-b53e-99b6505fd0cd tempest-VolumesServicesTestJSON-714989074 None] Lock "cinder-4d188ba2-7125-47ba-b8d8-05a3d011e862-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:26 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=61,cinder:INSERT=20,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:15:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:27 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:27 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Flow 'volume_create_manager' (0600fe75-14a6-49e8-9ff5-37deba094bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea04672-bb88-49d7-8768-3e9ac70b97f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea04672-bb88-49d7-8768-3e9ac70b97f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1175739944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b4e1a0-5564-4102-a113-e0e1fbb5f838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1deefe161b7484cb7b4ed77f16b503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:27Z,use_quota=True,user_id='e4eebfa0a49243dc9e763cda53fe5758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2268a88-0181-400d-b872-0ec9f24ccb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2268a88-0181-400d-b872-0ec9f24ccb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb8518a-f1c5-43e5-b221-692e2e588643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb8518a-f1c5-43e5-b221-692e2e588643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b4e1a0-5564-4102-a113-e0e1fbb5f838', 'volume_name': 'volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5fe2aa-0e6a-4f34-b84b-f61e29371eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5fe2aa-0e6a-4f34-b84b-f61e29371eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24d8eb8-61d0-4985-a353-5ce7a5174b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Volume f0b4e1a0-5564-4102-a113-e0e1fbb5f838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838', 'volume_size': 1} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1175739944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b4e1a0-5564-4102-a113-e0e1fbb5f838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1deefe161b7484cb7b4ed77f16b503a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:27Z,use_quota=True,user_id='e4eebfa0a49243dc9e763cda53fe5758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Creating volume f0b4e1a0-5564-4102-a113-e0e1fbb5f838 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:27 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:15:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:27 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 1073741824 Jul 06 12:15:27 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:28 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.482s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:15:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:15:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:15:29 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 1073741824" returned: 0 in 2.095s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:29 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 Jul 06 12:15:29 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:30 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838" returned: 0 in 0.917s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] <== create_volume: return (3103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.113s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24d8eb8-61d0-4985-a353-5ce7a5174b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d4b4a-2c30-4d13-9877-a6345017cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Volume volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 (f0b4e1a0-5564-4102-a113-e0e1fbb5f838): created successfully Jul 06 12:15:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d4b4a-2c30-4d13-9877-a6345017cecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Flow 'volume_create_manager' (0600fe75-14a6-49e8-9ff5-37deba094bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:30 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cf6ad89b-1245-4b13-b5d1-38f11522efc6 tempest-VolumesMetadataTest-1437476915 None] Created volume successfully. Jul 06 12:15:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Acquiring lock "cinder-f0b4e1a0-5564-4102-a113-e0e1fbb5f838-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Lock "cinder-f0b4e1a0-5564-4102-a113-e0e1fbb5f838-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:33 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=88,cinder:DELETE=9,cinder:SELECT=66,cinder:INSERT=16 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Acquiring lock "cinder-quobyte-f0b4e1a0-5564-4102-a113-e0e1fbb5f838" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Lock "cinder-quobyte-f0b4e1a0-5564-4102-a113-e0e1fbb5f838" acquired by "delete_volume" :: waited 0.043s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:33 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6fbc27-0ebe-442a-8e0e-a504b42ab880]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:33 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 Jul 06 12:15:33 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:36 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838" returned: 0 in 2.453s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:36 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838 Jul 06 12:15:36 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:37 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f0b4e1a0-5564-4102-a113-e0e1fbb5f838" returned: 0 in 1.539s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Lock "cinder-quobyte-f0b4e1a0-5564-4102-a113-e0e1fbb5f838" released by "delete_volume" :: held 4.093s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Created reservations ['471bd40f-9433-4d39-9ea9-ce38fc136bbf', '105c66e0-5e3b-4908-af2f-0b70c996fc46', 'fa9c7265-c579-446c-8e9d-cb3f1bfa8574', 'cb76d355-5b6d-45a2-a169-94776354f208'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:38 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:38 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:39 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.011s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:39 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Deleted volume successfully. Jul 06 12:15:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c79ccbc8-9a66-4a00-a279-6fd8f08b51af tempest-VolumesMetadataTest-1437476915 None] Lock "cinder-f0b4e1a0-5564-4102-a113-e0e1fbb5f838-delete_volume" released by "delete_volume" :: held 5.558s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:43 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (5d2e49b6-d1da-458a-8203-9107016b4fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed0a6a3-630f-4a30-bde0-7cd5166e412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed0a6a3-630f-4a30-bde0-7cd5166e412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-309998546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f733d97-8b88-4efe-ab51-3eb045ce4e74,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:44Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a5707f-a4b1-495b-9d9e-94c06dfe7af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a5707f-a4b1-495b-9d9e-94c06dfe7af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee2bbbb-fd84-4706-ba37-0f0f91ed049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee2bbbb-fd84-4706-ba37-0f0f91ed049a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f733d97-8b88-4efe-ab51-3eb045ce4e74', 'volume_name': 'volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2272232-164e-4b0a-b68a-b40f71ce9465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2272232-164e-4b0a-b68a-b40f71ce9465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de8bee-6cc6-4507-bb39-cc5b3fea9e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:44 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Volume 4f733d97-8b88-4efe-ab51-3eb045ce4e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74', 'volume_size': 1} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-309998546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f733d97-8b88-4efe-ab51-3eb045ce4e74,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:44Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Creating volume 4f733d97-8b88-4efe-ab51-3eb045ce4e74 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:44 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:15:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:44 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 1073741824 Jul 06 12:15:44 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:45 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 1073741824" returned: 0 in 1.501s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:45 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 Jul 06 12:15:45 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:46 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74" returned: 0 in 1.044s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] <== create_volume: return (2634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.640s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de8bee-6cc6-4507-bb39-cc5b3fea9e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39eadd90-b005-48ed-9bb7-dba1432ee0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:46 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Volume volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 (4f733d97-8b88-4efe-ab51-3eb045ce4e74): created successfully Jul 06 12:15:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39eadd90-b005-48ed-9bb7-dba1432ee0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (5d2e49b6-d1da-458a-8203-9107016b4fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ebad07ca-824b-43bf-a26d-6d2fbca2a6c7 tempest-VolumesGetTest-1460836946 None] Created volume successfully. Jul 06 12:15:48 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (656a4388-3a3c-4d1d-8d42-65938aa2bc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6385c89-9391-4958-b948-df6f8293ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6385c89-9391-4958-b948-df6f8293ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2045846289',display_name='tempest-VolumesGetTest-Volume-382285301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4e966b-24b1-4e89-8bbc-c86fbca4018b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:49Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb5e32c-dc77-4254-88e3-95e356726360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb5e32c-dc77-4254-88e3-95e356726360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa4a718-557e-4cd0-8fd9-d2f0030d087f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa4a718-557e-4cd0-8fd9-d2f0030d087f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4e966b-24b1-4e89-8bbc-c86fbca4018b', 'volume_name': 'volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363d9d6-796c-4e1d-851b-6871936403d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363d9d6-796c-4e1d-851b-6871936403d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4128259-3ac3-4cb8-987d-408ad2f357c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:49 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Volume 1b4e966b-24b1-4e89-8bbc-c86fbca4018b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b', 'volume_size': 1} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2045846289',display_name='tempest-VolumesGetTest-Volume-382285301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4e966b-24b1-4e89-8bbc-c86fbca4018b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:49Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Creating volume 1b4e966b-24b1-4e89-8bbc-c86fbca4018b {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:49 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:15:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:49 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b 1073741824 Jul 06 12:15:49 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:50 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b 1073741824" returned: 0 in 1.178s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:50 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b Jul 06 12:15:50 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:51 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b" returned: 0 in 1.098s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4128259-3ac3-4cb8-987d-408ad2f357c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11d1689-f626-448a-95bd-6dc56cfa9c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Volume volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b (1b4e966b-24b1-4e89-8bbc-c86fbca4018b): created successfully Jul 06 12:15:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11d1689-f626-448a-95bd-6dc56cfa9c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (656a4388-3a3c-4d1d-8d42-65938aa2bc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-494e98fe-4d8b-410e-8ab6-8880168129e5 tempest-VolumesGetTest-1460836946 None] Created volume successfully. Jul 06 12:15:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-1b4e966b-24b1-4e89-8bbc-c86fbca4018b-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Lock "cinder-1b4e966b-24b1-4e89-8bbc-c86fbca4018b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-1b4e966b-24b1-4e89-8bbc-c86fbca4018b" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-1b4e966b-24b1-4e89-8bbc-c86fbca4018b" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fea3c8-2858-4942-ab1d-ac3f3a42e105]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:52 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b Jul 06 12:15:52 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:53 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b" returned: 0 in 0.955s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:53 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b Jul 06 12:15:53 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:54 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4e966b-24b1-4e89-8bbc-c86fbca4018b" returned: 0 in 0.698s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-1b4e966b-24b1-4e89-8bbc-c86fbca4018b" released by "delete_volume" :: held 1.716s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Created reservations ['591f7b89-1ed3-455a-990b-8e514e8e6542', '6b9ad2ee-daea-4e39-b89f-b998c9240a30', 'a133e454-d880-49bd-8249-0bd218df096a', 'eaef5048-aff5-43c9-a2b6-770b0e299c95'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:54 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:54 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-4f733d97-8b88-4efe-ab51-3eb045ce4e74-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Lock "cinder-4f733d97-8b88-4efe-ab51-3eb045ce4e74-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-4f733d97-8b88-4efe-ab51-3eb045ce4e74" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-4f733d97-8b88-4efe-ab51-3eb045ce4e74" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d95133-f464-47ed-b9c8-d3016371c06e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:55 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 Jul 06 12:15:55 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:55 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.911s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:55 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Deleted volume successfully. Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Flow 'volume_create_manager' (2abab8d9-1aea-4076-93ce-11106d816ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f861f61c-dee1-46c1-81ce-e74f4d9f3ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f861f61c-dee1-46c1-81ce-e74f4d9f3ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-426159368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db33563f-fc22-4b1d-8dad-c6721756634c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed356b78907c4f468e42161357ad3409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:55Z,use_quota=True,user_id='395f3e7d608d4ffe8647002c79a1d783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6ff020-ccb0-449e-a190-c8c650d44baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6ff020-ccb0-449e-a190-c8c650d44baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d7573d-8c82-4600-af1a-1305adc03d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d7573d-8c82-4600-af1a-1305adc03d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db33563f-fc22-4b1d-8dad-c6721756634c', 'volume_name': 'volume-db33563f-fc22-4b1d-8dad-c6721756634c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d145410-52bf-4500-b164-5ab963180860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d145410-52bf-4500-b164-5ab963180860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc517e3-d970-4491-9919-499c4912f29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Volume db33563f-fc22-4b1d-8dad-c6721756634c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db33563f-fc22-4b1d-8dad-c6721756634c', 'volume_size': 1} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-426159368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db33563f-fc22-4b1d-8dad-c6721756634c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed356b78907c4f468e42161357ad3409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:55Z,use_quota=True,user_id='395f3e7d608d4ffe8647002c79a1d783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Creating volume db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:55 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5741b39-984b-4a4b-a5dd-711a599ea1d6 tempest-VolumesGetTest-1460836946 None] Lock "cinder-1b4e966b-24b1-4e89-8bbc-c86fbca4018b-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:55 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c 1073741824 Jul 06 12:15:55 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:55 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74" returned: 0 in 0.866s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:55 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74 Jul 06 12:15:55 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:56 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c 1073741824" returned: 0 in 0.893s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:56 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c Jul 06 12:15:56 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:56 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4f733d97-8b88-4efe-ab51-3eb045ce4e74" returned: 0 in 0.693s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-4f733d97-8b88-4efe-ab51-3eb045ce4e74" released by "delete_volume" :: held 1.623s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Created reservations ['60675f00-88ad-4083-8cc2-c82928872f29', '2604b390-ec12-4f98-afce-0cd928fe8981', '297f4998-e3a5-4a09-a95d-5d79cc3a1bc7', '4224d6bc-2c8b-4d61-ba14-e1643eb79941'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:56 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:15:56 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:57 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c" returned: 0 in 0.712s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc517e3-d970-4491-9919-499c4912f29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db33563f-fc22-4b1d-8dad-c6721756634c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18295209-4865-438e-a08c-7b1cd97c56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Volume volume-db33563f-fc22-4b1d-8dad-c6721756634c (db33563f-fc22-4b1d-8dad-c6721756634c): created successfully Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18295209-4865-438e-a08c-7b1cd97c56f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Flow 'volume_create_manager' (2abab8d9-1aea-4076-93ce-11106d816ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d0633e9d-afc8-4ba4-b2da-ee375eda0413 tempest-SnapshotMetadataTestJSON-983272497 None] Created volume successfully. Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Flow 'volume_create_manager' (f020888c-ecea-412d-b13d-2988ab45e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6541bca9-a23d-41cb-8d11-9fa9f615f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.798s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6541bca9-a23d-41cb-8d11-9fa9f615f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1102930353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ae799e-077f-4f4a-87e0-280fda3bdee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21e5a87c06946f9a90a36e1f1f10f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:57Z,use_quota=True,user_id='aa6effd082e648b9afe49f79545e6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818c21d4-9ab6-4ccb-86a7-685225cf5bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818c21d4-9ab6-4ccb-86a7-685225cf5bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1499f2e2-d666-4100-b2f3-2927098faa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1499f2e2-d666-4100-b2f3-2927098faa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ae799e-077f-4f4a-87e0-280fda3bdee4', 'volume_name': 'volume-23ae799e-077f-4f4a-87e0-280fda3bdee4', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a4dc1f-8726-47ff-8b93-0ecfc4e56c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a4dc1f-8726-47ff-8b93-0ecfc4e56c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0fdb3e-158a-483f-adea-6ab6a22bbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Volume 23ae799e-077f-4f4a-87e0-280fda3bdee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ae799e-077f-4f4a-87e0-280fda3bdee4', 'volume_size': 1} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1102930353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ae799e-077f-4f4a-87e0-280fda3bdee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21e5a87c06946f9a90a36e1f1f10f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:57Z,use_quota=True,user_id='aa6effd082e648b9afe49f79545e6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Creating volume 23ae799e-077f-4f4a-87e0-280fda3bdee4 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:57 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Deleted volume successfully. Jul 06 12:15:57 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 1073741824 Jul 06 12:15:57 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2166cb0e-8b71-4aff-a486-d6cb53bdefab tempest-VolumesGetTest-1460836946 None] Lock "cinder-4f733d97-8b88-4efe-ab51-3eb045ce4e74-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (254d61f5-a7d0-4d98-af23-c8e8272a9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09516b9c-b63c-4758-81c0-c725a5ccb9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09516b9c-b63c-4758-81c0-c725a5ccb9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1904926602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7278044d-6648-4947-84e1-c615d2ff2372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:58Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fdb83c-c8f6-442d-a0a7-55a3450d84a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fdb83c-c8f6-442d-a0a7-55a3450d84a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cb8796-d0bc-40bc-8194-0e139922107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cb8796-d0bc-40bc-8194-0e139922107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7278044d-6648-4947-84e1-c615d2ff2372', 'volume_name': 'volume-7278044d-6648-4947-84e1-c615d2ff2372', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83231d18-ccdb-4567-9eeb-382b78b52b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83231d18-ccdb-4567-9eeb-382b78b52b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f157eb0d-aaf1-43af-96eb-c5d33c62b358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Volume 7278044d-6648-4947-84e1-c615d2ff2372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7278044d-6648-4947-84e1-c615d2ff2372', 'volume_size': 1} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:58 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 1073741824" returned: 0 in 0.920s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:58 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 Jul 06 12:15:58 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:59 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4" returned: 0 in 0.656s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1904926602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7278044d-6648-4947-84e1-c615d2ff2372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:58Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Creating volume 7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:59 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0fdb3e-158a-483f-adea-6ab6a22bbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ae799e-077f-4f4a-87e0-280fda3bdee4', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:59 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 1073741824 Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a168ef42-d9af-485d-b285-712cb175c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:59 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:59 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Volume volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 (23ae799e-077f-4f4a-87e0-280fda3bdee4): created successfully Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a168ef42-d9af-485d-b285-712cb175c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Flow 'volume_create_manager' (f020888c-ecea-412d-b13d-2988ab45e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c92f735f-ca59-4cab-9fab-6d881d0c3974 tempest-ServersNegativeTestJSON-86441259 None] Created volume successfully. Jul 06 12:16:00 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 1073741824" returned: 0 in 0.978s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:00 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 Jul 06 12:16:00 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:00 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Flow 'volume_create_manager' (0da54a92-c700-4d62-acd0-daee3ce9fb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7579e6-658a-4690-ac98-4ca6d1537001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7579e6-658a-4690-ac98-4ca6d1537001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655180933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c86a6e-15b6-449d-bd20-22f12e95011a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21e5a87c06946f9a90a36e1f1f10f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:01Z,use_quota=True,user_id='aa6effd082e648b9afe49f79545e6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa15063-f403-4326-8c26-620449f6bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa15063-f403-4326-8c26-620449f6bf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6014b745-9f44-443f-b240-8c387241caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6014b745-9f44-443f-b240-8c387241caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c86a6e-15b6-449d-bd20-22f12e95011a', 'volume_name': 'volume-69c86a6e-15b6-449d-bd20-22f12e95011a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8037a1-2cb7-47df-b184-559461f4bf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8037a1-2cb7-47df-b184-559461f4bf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d240cd-30d8-4bb6-9dfd-829958e41fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Volume 69c86a6e-15b6-449d-bd20-22f12e95011a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c86a6e-15b6-449d-bd20-22f12e95011a', 'volume_size': 1} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372" returned: 0 in 0.837s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.227s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f157eb0d-aaf1-43af-96eb-c5d33c62b358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7278044d-6648-4947-84e1-c615d2ff2372', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77de3fa-e022-4b54-a7b6-eb1f9bd70c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Creating offline snapshot 81efcf50-75df-49ab-be49-179b3ef92e50 of volume db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:16:01 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Volume volume-7278044d-6648-4947-84e1-c615d2ff2372 (7278044d-6648-4947-84e1-c615d2ff2372): created successfully Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77de3fa-e022-4b54-a7b6-eb1f9bd70c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (254d61f5-a7d0-4d98-af23-c8e8272a9b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aa5880-0b35-41ee-9112-24ce586b79b3]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-16318f5e-7e37-4b70-8518-81ba2bf25653 tempest-VolumesGetTest-1460836946 None] Created volume successfully. Jul 06 12:16:01 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c Jul 06 12:16:01 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:02 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c" returned: 0 in 1.150s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:02 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 1G Jul 06 12:16:02 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (38f79763-2a5d-46b7-8a6a-74a2c81e4de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f280cd-0b81-451d-a9c1-cafee791fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f280cd-0b81-451d-a9c1-cafee791fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2093222578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6608b841-7233-4acf-bfc9-15922cfe1d63,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7278044d-6648-4947-84e1-c615d2ff2372,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:03Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7eb63bf-e571-4c37-a014-3bb3ba6fbee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7eb63bf-e571-4c37-a014-3bb3ba6fbee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74418c25-87b8-4720-832d-82cab9fab3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74418c25-87b8-4720-832d-82cab9fab3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6608b841-7233-4acf-bfc9-15922cfe1d63', 'volume_name': 'volume-6608b841-7233-4acf-bfc9-15922cfe1d63', 'volume_size': 1, 'source_volid': '7278044d-6648-4947-84e1-c615d2ff2372', 'source_volstatus': 'available'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b811143-3616-430e-b111-9148ca8f2d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b811143-3616-430e-b111-9148ca8f2d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8d7dee-e172-4db5-8095-a9aab7d56238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:02 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Volume 6608b841-7233-4acf-bfc9-15922cfe1d63: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6608b841-7233-4acf-bfc9-15922cfe1d63', 'volume_size': 1, 'source_volid': '7278044d-6648-4947-84e1-c615d2ff2372', 'source_volstatus': 'available'} Jul 06 12:16:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:03 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 1G" returned: 0 in 1.140s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db33563f-fc22-4b1d-8dad-c6721756634c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:03 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db33563f-fc22-4b1d-8dad-c6721756634c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 Jul 06 12:16:03 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:04 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db33563f-fc22-4b1d-8dad-c6721756634c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50" returned: 0 in 0.929s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:04 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 is being set with open permissions: ugo+rw Jul 06 12:16:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:04 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 Jul 06 12:16:04 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:05 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50" returned: 0 in 0.805s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:05 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.info Jul 06 12:16:05 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:06 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.info" returned: 0 in 0.782s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:06 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.info is being set with open permissions: ugo+rw Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:06 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.info Jul 06 12:16:06 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-33a5e0be-4db5-41f8-afdd-34a84e4e9662 tempest-TestShelveInstance-1734523983 None] Terminate volume connection completed successfully. Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-33a5e0be-4db5-41f8-afdd-34a84e4e9662 tempest-TestShelveInstance-1734523983 None] Deleting attachment fbb177ca-89f2-401d-adc6-909b21d48fd6. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:16:06 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.info" returned: 0 in 0.710s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.681s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.689s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1655180933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c86a6e-15b6-449d-bd20-22f12e95011a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21e5a87c06946f9a90a36e1f1f10f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:01Z,use_quota=True,user_id='aa6effd082e648b9afe49f79545e6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Creating volume 69c86a6e-15b6-449d-bd20-22f12e95011a {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:06 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:16:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:06 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a 1073741824 Jul 06 12:16:06 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-da239607-da8d-4a4b-a778-81b2be669358 tempest-SnapshotMetadataTestJSON-983272497 None] Create snapshot completed successfully Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Acquiring lock "cinder-3d4380c6-e8b9-464b-920b-e03736478207-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Lock "cinder-3d4380c6-e8b9-464b-920b-e03736478207-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Acquiring lock "cinder-quobyte-3d4380c6-e8b9-464b-920b-e03736478207" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Lock "cinder-quobyte-3d4380c6-e8b9-464b-920b-e03736478207" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c32cd-7e75-4862-8c72-73e8882cdff5]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:07 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:16:07 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:07 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a 1073741824" returned: 0 in 1.094s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:07 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a Jul 06 12:16:07 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "cinder-81efcf50-75df-49ab-be49-179b3ef92e50-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:08 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 0 in 0.967s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-81efcf50-75df-49ab-be49-179b3ef92e50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "cinder-quobyte-db33563f-fc22-4b1d-8dad-c6721756634c" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-quobyte-db33563f-fc22-4b1d-8dad-c6721756634c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "cinder-quobyte-81efcf50-75df-49ab-be49-179b3ef92e50" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-quobyte-81efcf50-75df-49ab-be49-179b3ef92e50" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Deleting offline snapshot 81efcf50-75df-49ab-be49-179b3ef92e50 of volume db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] snapshot_file for this snap is: volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a8b6cc-3852-4a7d-b2db-2e6711288993]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:08 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:16:08 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:08 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 Jul 06 12:16:08 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:08 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a" returned: 0 in 0.830s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.763s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:08 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Cloning volume 7278044d-6648-4947-84e1-c615d2ff2372 to volume 6608b841-7233-4acf-bfc9-15922cfe1d63 Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d240cd-30d8-4bb6-9dfd-829958e41fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c86a6e-15b6-449d-bd20-22f12e95011a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e1ac7a-4807-490e-99f3-76b2c45355f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:08 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Volume volume-69c86a6e-15b6-449d-bd20-22f12e95011a (69c86a6e-15b6-449d-bd20-22f12e95011a): created successfully Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e1ac7a-4807-490e-99f3-76b2c45355f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Flow 'volume_create_manager' (0da54a92-c700-4d62-acd0-daee3ce9fb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Creating offline snapshot b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c of volume 7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:16:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8ed27597-de90-4de5-a3a4-bc16bdd07b55 tempest-ServersNegativeTestJSON-86441259 None] Created volume successfully. Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ae943-2d15-4f2c-b722-26c133bee228]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:09 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 Jul 06 12:16:09 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:09 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 1 in 1.101s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:09 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207 Jul 06 12:16:09 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:09 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50" returned: 0 in 1.220s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db33563f-fc22-4b1d-8dad-c6721756634c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e773b3d-060b-45fe-9fde-bee3fc8df0b6]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:09 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c Jul 06 12:16:09 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:09 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372" returned: 0 in 1.087s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:10 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c 1G Jul 06 12:16:10 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:10 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3d4380c6-e8b9-464b-920b-e03736478207" returned: 0 in 1.193s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Lock "cinder-quobyte-3d4380c6-e8b9-464b-920b-e03736478207" released by "delete_volume" :: held 3.386s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.quota [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Created reservations ['cfd3d74c-7997-4122-8ccc-9b20b0f9aaf8', '8874bb68-6119-4cda-bc70-f1d8ca5e13a9', 'e40db41a-8ed7-48c0-a174-4a9206874fdd', '20b51c3c-72ca-4e3b-8d95-1a2ee0f95910'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "cinder-69c86a6e-15b6-449d-bd20-22f12e95011a-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-69c86a6e-15b6-449d-bd20-22f12e95011a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:10 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:10 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "cinder-quobyte-69c86a6e-15b6-449d-bd20-22f12e95011a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-quobyte-69c86a6e-15b6-449d-bd20-22f12e95011a" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8964e-9fb5-49e2-b49b-1176446ab12e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:11 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c" returned: 0 in 1.423s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:11 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 Jul 06 12:16:11 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:11 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a Jul 06 12:16:11 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:11 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c 1G" returned: 0 in 1.541s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7278044d-6648-4947-84e1-c615d2ff2372 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:11 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7278044d-6648-4947-84e1-c615d2ff2372 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c Jul 06 12:16:11 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:11 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.978s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG cinder.manager [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Deleted volume successfully. Jul 06 12:16:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-1dc3e68e-87b9-47b1-ae18-f750f43d53b8 req-2676b9c8-17e6-4c28-a916-2146ccc7aee5 tempest-TestShelveInstance-1734523983 None] Lock "cinder-3d4380c6-e8b9-464b-920b-e03736478207-delete_volume" released by "delete_volume" :: held 4.799s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:12 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50" returned: 0 in 1.060s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:12 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50 Jul 06 12:16:12 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:12 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a" returned: 0 in 1.418s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:12 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a Jul 06 12:16:12 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:12 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7278044d-6648-4947-84e1-c615d2ff2372 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" returned: 0 in 0.998s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:12 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c is being set with open permissions: ugo+rw Jul 06 12:16:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:12 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c Jul 06 12:16:12 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:13 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c.81efcf50-75df-49ab-be49-179b3ef92e50" returned: 0 in 0.951s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-quobyte-81efcf50-75df-49ab-be49-179b3ef92e50" released by "_delete_snapshot" :: held 4.829s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-quobyte-db33563f-fc22-4b1d-8dad-c6721756634c" released by "delete_snapshot" :: held 4.871s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Created reservations ['a571cf25-3dcd-4470-9cb4-7eed76210ed4', '3d9647e2-5a09-4a1b-8154-55ce0b921151', 'b48ac5de-42d6-412b-bc2e-b64918e01eb1', '09d4bbf3-e0f0-4bff-9c11-e088b23c9bdb'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:13 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c86a6e-15b6-449d-bd20-22f12e95011a" returned: 0 in 0.904s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Delete snapshot completed successfully. Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-quobyte-69c86a6e-15b6-449d-bd20-22f12e95011a" released by "delete_volume" :: held 2.392s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1aa07015-f5fe-4c6c-a29a-4171699ff328 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-81efcf50-75df-49ab-be49-179b3ef92e50-delete_snapshot" released by "delete_snapshot" :: held 5.125s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Created reservations ['fe149803-0a1d-4719-b14c-145d68ad9798', '8055c8df-6bf7-4ac1-b359-00490e3c5aa1', '555dcbee-ef66-45f4-8b9f-3fa61d97c436', '445a37e8-ec6a-413f-93e6-d13298deb36e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:13 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" returned: 0 in 0.944s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:13 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.info Jul 06 12:16:13 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:13 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:13 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "cinder-db33563f-fc22-4b1d-8dad-c6721756634c-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-db33563f-fc22-4b1d-8dad-c6721756634c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "cinder-quobyte-db33563f-fc22-4b1d-8dad-c6721756634c" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-quobyte-db33563f-fc22-4b1d-8dad-c6721756634c" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[987cb683-5fb2-4559-8783-8e08f8b38882]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "cinder-23ae799e-077f-4f4a-87e0-280fda3bdee4-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-23ae799e-077f-4f4a-87e0-280fda3bdee4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "cinder-quobyte-23ae799e-077f-4f4a-87e0-280fda3bdee4" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-quobyte-23ae799e-077f-4f4a-87e0-280fda3bdee4" acquired by "delete_volume" :: waited 0.013s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:14 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c Jul 06 12:16:14 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4822c-ec50-4fd9-8737-682a8db8d7cb]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:14 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.962s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Deleted volume successfully. Jul 06 12:16:14 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 Jul 06 12:16:14 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-37087713-3836-4aaa-9ffe-ca981cbbcefb tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-69c86a6e-15b6-449d-bd20-22f12e95011a-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:14 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.info" returned: 0 in 1.118s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:14 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.info is being set with open permissions: ugo+rw Jul 06 12:16:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:14 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.info Jul 06 12:16:14 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:15 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c" returned: 0 in 1.389s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:15 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c Jul 06 12:16:15 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:15 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.info" returned: 0 in 0.968s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:15 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-6608b841-7233-4acf-bfc9-15922cfe1d63" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4" returned: 0 in 1.281s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-6608b841-7233-4acf-bfc9-15922cfe1d63" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] snapshot: b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c, volume: 6608b841-7233-4acf-bfc9-15922cfe1d63, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:16:15 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4 Jul 06 12:16:15 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6785eb-f446-437f-9cf9-5c441a548457]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:15 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c Jul 06 12:16:15 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:16 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-db33563f-fc22-4b1d-8dad-c6721756634c" returned: 0 in 0.986s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-quobyte-db33563f-fc22-4b1d-8dad-c6721756634c" released by "delete_volume" :: held 2.534s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Created reservations ['30c8d7e7-ed09-4855-b3de-d45132dc7ec9', 'ea3dc5a4-364b-4726-a175-586a8ae2f410', '67b01696-60b0-47eb-b2d0-9a9ba8f4bda2', 'fc7ce197-5b59-458c-96ee-aee3d8c6cc9a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:16 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23ae799e-077f-4f4a-87e0-280fda3bdee4" returned: 0 in 1.071s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-quobyte-23ae799e-077f-4f4a-87e0-280fda3bdee4" released by "delete_volume" :: held 2.437s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:16 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:16 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Created reservations ['ed6ce4ff-aaaa-480f-9ae3-9544d42942da', '65beaa48-33dc-4b65-81b3-d9a002768545', '76fc7da2-4491-4d99-bdf4-bd180812b8e3', '63d2b406-258a-4e36-bccd-593c908cf661'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:16 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" returned: 0 in 1.176s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7278044d-6648-4947-84e1-c615d2ff2372(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22c54bb-87d8-4a29-9e57-592f9f172689]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:17 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:17 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:17 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 Jul 06 12:16:17 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:17 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.970s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:17 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Deleted volume successfully. Jul 06 12:16:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1af2064c-6a22-4055-8680-101525953d50 tempest-SnapshotMetadataTestJSON-983272497 None] Lock "cinder-db33563f-fc22-4b1d-8dad-c6721756634c-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:18 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372" returned: 0 in 1.394s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:18 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:18 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:16:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.351s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:18 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Deleted volume successfully. Jul 06 12:16:18 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 Jul 06 12:16:18 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad36daa7-404e-4077-903b-95cc7a621969 tempest-ServersNegativeTestJSON-86441259 None] Lock "cinder-23ae799e-077f-4f4a-87e0-280fda3bdee4-delete_volume" released by "delete_volume" :: held 4.162s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Flow 'volume_create_manager' (6f3f0d63-ec51-48d4-8de5-98f62649ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db29230-9264-4afa-bd29-568d26e30d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db29230-9264-4afa-bd29-568d26e30d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-403820918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced0e319-fe38-4d8a-b593-891681ffebe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101c642b669445e599093027f21887b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:25Z,use_quota=True,user_id='af55a9ce86564e989337dc6008b1f940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63227ce-22e9-41cb-8426-46bffe74412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63227ce-22e9-41cb-8426-46bffe74412e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003ab96a-4987-4c24-97b7-32a6d4e31074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003ab96a-4987-4c24-97b7-32a6d4e31074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced0e319-fe38-4d8a-b593-891681ffebe1', 'volume_name': 'volume-ced0e319-fe38-4d8a-b593-891681ffebe1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e5d829-a4b8-44b4-93f9-25ab21900daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e5d829-a4b8-44b4-93f9-25ab21900daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8e7584-7dd1-4bec-af65-5d83a7cc91eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:25 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Volume ced0e319-fe38-4d8a-b593-891681ffebe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced0e319-fe38-4d8a-b593-891681ffebe1', 'volume_size': 1} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:25 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63" returned: 0 in 7.355s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3201f0e2-dad9-4d1f-8d71-90fa23239f2c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:25 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 Jul 06 12:16:25 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:26 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372" returned: 0 in 1.043s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:26 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:16:26 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Converted 1024.00 MB image at 139.21 MB/s Jul 06 12:16:26 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 is being set with open permissions: ugo+rw Jul 06 12:16:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:26 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 Jul 06 12:16:26 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:16:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:27 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:27 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:27 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63" returned: 0 in 0.808s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-6608b841-7233-4acf-bfc9-15922cfe1d63" released by "_copy_volume_from_snapshot" :: held 11.886s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=68,cinder:UPDATE=90,cinder:DELETE=7,cinder:INSERT=25 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Deleting offline snapshot b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c of volume 7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] snapshot_file for this snap is: volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[720b7e01-2bf2-436f-8686-3bbb3e3dd3a7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:27 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c Jul 06 12:16:27 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:27 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.784s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:16:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:16:28 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" returned: 0 in 0.888s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7278044d-6648-4947-84e1-c615d2ff2372(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:28 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3ec652-3018-42ea-90b7-faf060568e6c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:28 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 Jul 06 12:16:28 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:29 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372" returned: 0 in 0.885s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:29 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c Jul 06 12:16:29 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:30 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" returned: 0 in 0.851s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:30 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c Jul 06 12:16:30 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:31 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372.b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-b7e1ee34-05ec-4ec3-9546-b7ffcdcd964c" released by "_delete_snapshot" :: held 3.552s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.453s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.570s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-403820918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced0e319-fe38-4d8a-b593-891681ffebe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101c642b669445e599093027f21887b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:25Z,use_quota=True,user_id='af55a9ce86564e989337dc6008b1f940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Creating volume ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:31 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:31 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 1073741824 Jul 06 12:16:31 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8d7dee-e172-4db5-8095-a9aab7d56238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6608b841-7233-4acf-bfc9-15922cfe1d63', 'volume_size': 1, 'source_volid': '7278044d-6648-4947-84e1-c615d2ff2372', 'source_volstatus': 'available'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a580d0bd-6a50-4a6f-8478-6289640484a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Volume volume-6608b841-7233-4acf-bfc9-15922cfe1d63 (6608b841-7233-4acf-bfc9-15922cfe1d63): created successfully Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a580d0bd-6a50-4a6f-8478-6289640484a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (38f79763-2a5d-46b7-8a6a-74a2c81e4de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:31 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d8487cfe-f5b8-468e-a085-af2b65b892c9 tempest-VolumesGetTest-1460836946 None] Created volume successfully. Jul 06 12:16:32 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 1073741824" returned: 0 in 1.137s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:32 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 Jul 06 12:16:32 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (e63ef9a5-f915-4971-8af3-d63347f611e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5d3546-5835-4e55-a2a0-79a850372c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5d3546-5835-4e55-a2a0-79a850372c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2090331088',display_name='tempest-VolumesGetTest-Volume-1182685861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9ed836-b585-423b-abbe-56630da937fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:33Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc34e89-4f73-4b24-b568-ca9e193b1775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc34e89-4f73-4b24-b568-ca9e193b1775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8520c8ca-c38d-4f89-91df-89bb5f3b3584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8520c8ca-c38d-4f89-91df-89bb5f3b3584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9ed836-b585-423b-abbe-56630da937fb', 'volume_name': 'volume-2c9ed836-b585-423b-abbe-56630da937fb', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a435d08a-0e9c-4256-afee-33cf6aa59f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a435d08a-0e9c-4256-afee-33cf6aa59f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc6d2ae-545d-438d-a38a-9d0fe80f4857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Volume 2c9ed836-b585-423b-abbe-56630da937fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9ed836-b585-423b-abbe-56630da937fb', 'volume_size': 1} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:33 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1" returned: 0 in 0.988s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] <== create_volume: return (2256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2090331088',display_name='tempest-VolumesGetTest-Volume-1182685861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9ed836-b585-423b-abbe-56630da937fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:33Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Creating volume 2c9ed836-b585-423b-abbe-56630da937fb {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:33 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8e7584-7dd1-4bec-af65-5d83a7cc91eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced0e319-fe38-4d8a-b593-891681ffebe1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:33 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb 1073741824 Jul 06 12:16:33 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2152a5b0-f2dc-485a-a9ae-171102a5b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Volume volume-ced0e319-fe38-4d8a-b593-891681ffebe1 (ced0e319-fe38-4d8a-b593-891681ffebe1): created successfully Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2152a5b0-f2dc-485a-a9ae-171102a5b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Flow 'volume_create_manager' (6f3f0d63-ec51-48d4-8de5-98f62649ca49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-bb7ac532-e633-4abd-9109-952def6b3296 tempest-VolumesDeleteCascade-319930899 None] Created volume successfully. Jul 06 12:16:34 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb 1073741824" returned: 0 in 1.044s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:34 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=64,cinder:UPDATE=87,cinder:DELETE=9,cinder:INSERT=17 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:16:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:34 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb Jul 06 12:16:34 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Flow 'volume_create_manager' (e4128913-878c-466f-b0f1-5ac84fdf4018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0797eecf-23de-4d47-92ec-b735dde31d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0797eecf-23de-4d47-92ec-b735dde31d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a3a6e2-203e-427a-b089-1abcce2f2482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb7efe6671b4d70b1a4be6eaaf1af30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:35Z,use_quota=True,user_id='9f03df926cb747d2ae629a9ec3a7ba7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(016b3f54-02f8-4955-a27c-f8d88f5741a9),volume_type_id=016b3f54-02f8-4955-a27c-f8d88f5741a9)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9712675-df07-4f78-9814-e117aba02a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9712675-df07-4f78-9814-e117aba02a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b069514f-cb3a-4dfa-8a77-7b940b5beef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:16:35 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb" returned: 0 in 0.960s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.411s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Creating offline snapshot 402e3e74-2539-42cd-87d4-e35739526041 of volume ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc6d2ae-545d-438d-a38a-9d0fe80f4857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9ed836-b585-423b-abbe-56630da937fb', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c549b883-f702-4153-994f-4284c7519e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8390f0-8e44-4afb-983e-19582f28f175]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:35 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Volume volume-2c9ed836-b585-423b-abbe-56630da937fb (2c9ed836-b585-423b-abbe-56630da937fb): created successfully Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c549b883-f702-4153-994f-4284c7519e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (e63ef9a5-f915-4971-8af3-d63347f611e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:35 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8313d274-96c0-4b7b-8eb5-ef3013cee813 tempest-VolumesGetTest-1460836946 None] Created volume successfully. Jul 06 12:16:35 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 Jul 06 12:16:35 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b069514f-cb3a-4dfa-8a77-7b940b5beef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1a3a6e2-203e-427a-b089-1abcce2f2482', 'volume_name': 'volume-e1a3a6e2-203e-427a-b089-1abcce2f2482', 'volume_size': 1, 'image_id': 'f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '065b9095eca4f0488890fcf13c514460', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fb7efe6671b4d70b1a4be6eaaf1af30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '100207a243d1b23f69976cdf90a50aa1982824ea860cd5d388fddb7ae749ad5d09fb1ecef9afcde82fcedc84b65264b9c1c2fee6bf4740a9b60ff30a3eb4ce42', 'id': 'f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'created_at': datetime.datetime(2026, 7, 6, 10, 16, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 16, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af59b491-ec25-422d-8e48-28cebc2172ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af59b491-ec25-422d-8e48-28cebc2172ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726f6781-d3bb-4214-b1c4-ad14b8059e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:35 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Volume e1a3a6e2-203e-427a-b089-1abcce2f2482: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1a3a6e2-203e-427a-b089-1abcce2f2482', 'volume_size': 1, 'image_id': 'f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '065b9095eca4f0488890fcf13c514460', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fb7efe6671b4d70b1a4be6eaaf1af30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '100207a243d1b23f69976cdf90a50aa1982824ea860cd5d388fddb7ae749ad5d09fb1ecef9afcde82fcedc84b65264b9c1c2fee6bf4740a9b60ff30a3eb4ce42', 'id': 'f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'created_at': datetime.datetime(2026, 7, 6, 10, 16, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 16, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Trying to clone e1a3a6e2-203e-427a-b089-1abcce2f2482 from image f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:16:35 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:16:35 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eda76b-2c86-47bb-9453-ab32ff48d93a]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:36 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD Jul 06 12:16:36 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:36 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1" returned: 0 in 0.917s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:36 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 1G Jul 06 12:16:36 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-2c9ed836-b585-423b-abbe-56630da937fb-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-2c9ed836-b585-423b-abbe-56630da937fb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-2c9ed836-b585-423b-abbe-56630da937fb" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-2c9ed836-b585-423b-abbe-56630da937fb" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf19f23-86fe-4f65-9be9-b952e12a0f68]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:36 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb Jul 06 12:16:36 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:37 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD" returned: 0 in 1.061s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:37 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD Jul 06 12:16:37 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:37 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 1G" returned: 0 in 1.173s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:37 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 Jul 06 12:16:37 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:37 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb" returned: 0 in 1.048s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:37 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb Jul 06 12:16:37 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:38 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD" returned: 1 in 1.174s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Temporary image f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 is fetched for user 9f03df926cb747d2ae629a9ec3a7ba7a. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[345d1490-f60a-4954-a405-e99ed2304a41]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:38 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD Jul 06 12:16:38 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:38 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041" returned: 0 in 1.019s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:38 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 is being set with open permissions: ugo+rw Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:38 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 Jul 06 12:16:38 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:38 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-2c9ed836-b585-423b-abbe-56630da937fb" returned: 0 in 0.872s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-2c9ed836-b585-423b-abbe-56630da937fb" released by "delete_volume" :: held 1.997s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Created reservations ['2d70b630-5dd9-49ce-8b6b-3123e378d4d8', '3b36e06d-e447-4b26-a290-d9a417f86a6b', '4ee15261-d76f-4063-a0bf-2c2adc6d8892', 'd7af6364-bf1c-477e-be6c-5b7eb2198927'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:39 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:39 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-6608b841-7233-4acf-bfc9-15922cfe1d63-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Lock "cinder-6608b841-7233-4acf-bfc9-15922cfe1d63-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-6608b841-7233-4acf-bfc9-15922cfe1d63" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-6608b841-7233-4acf-bfc9-15922cfe1d63" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a54e63-9dad-46b7-b3e9-910036668736]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:39 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD" returned: 0 in 1.144s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:39 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 Jul 06 12:16:39 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:39 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD Jul 06 12:16:39 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:39 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041" returned: 0 in 1.085s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:39 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.info Jul 06 12:16:39 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:39 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.007s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:39 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Deleted volume successfully. Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1d78f18a-cdab-43d3-b9c4-e811d9403fd5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-2c9ed836-b585-423b-abbe-56630da937fb-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:40 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63" returned: 0 in 1.199s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:40 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63 Jul 06 12:16:40 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:40 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD" returned: 1 in 1.108s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:40 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.info" returned: 0 in 0.994s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:40 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.info is being set with open permissions: ugo+rw Jul 06 12:16:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:40 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.info Jul 06 12:16:40 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:41 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6608b841-7233-4acf-bfc9-15922cfe1d63" returned: 0 in 0.790s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-6608b841-7233-4acf-bfc9-15922cfe1d63" released by "delete_volume" :: held 2.053s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Created reservations ['ea0fa5b9-e335-4d28-98ff-726e7167da05', 'fac61331-47ef-46b0-9688-8c17bccf98f2', '84865e57-e7f6-47ab-811b-9fee7fb6172f', 'fe3f55e7-e441-4770-bfb5-bfd58f71d9ca'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:41 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.info" returned: 0 in 0.796s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:41 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:41 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.103s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a3a6e2-203e-427a-b089-1abcce2f2482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb7efe6671b4d70b1a4be6eaaf1af30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:35Z,use_quota=True,user_id='9f03df926cb747d2ae629a9ec3a7ba7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(016b3f54-02f8-4955-a27c-f8d88f5741a9),volume_type_id=016b3f54-02f8-4955-a27c-f8d88f5741a9)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Creating volume e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:41 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:16:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:41 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 1073741824 Jul 06 12:16:41 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-64e2bcf6-d7a8-4b19-b295-82951184ca3c tempest-VolumesDeleteCascade-319930899 None] Create snapshot completed successfully Jul 06 12:16:42 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.794s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Deleted volume successfully. Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3b04ddda-1728-43fb-ae75-a25bb95f02a2 tempest-VolumesGetTest-1460836946 None] Lock "cinder-6608b841-7233-4acf-bfc9-15922cfe1d63-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-7278044d-6648-4947-84e1-c615d2ff2372-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-7278044d-6648-4947-84e1-c615d2ff2372-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:42 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 1073741824" returned: 0 in 1.192s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-7278044d-6648-4947-84e1-c615d2ff2372" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-7278044d-6648-4947-84e1-c615d2ff2372" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:42 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 Jul 06 12:16:42 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1b88d-83e9-4f80-960c-110f86282d0e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:43 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 Jul 06 12:16:43 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:43 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482" returned: 0 in 0.942s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.049s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Creating offline snapshot 964e0c15-9292-479b-b8ac-1c83e5ecddd8 of volume ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:16:43 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Attempting download of f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'metadata': {}}])) to volume e1a3a6e2-203e-427a-b089-1abcce2f2482. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:16:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4b7641-5188-472d-92ca-d6df9d0e1204]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e249c4c-2681-49ac-a8d5-a543cccd8fd1]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_a1n58bc0 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:44 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372" returned: 0 in 1.139s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:44 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 Jul 06 12:16:44 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:44 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372 Jul 06 12:16:44 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:44 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_a1n58bc0 Jul 06 12:16:44 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:45 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041" returned: 0 in 1.024s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced0e319-fe38-4d8a-b593-891681ffebe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:45 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7278044d-6648-4947-84e1-c615d2ff2372" returned: 0 in 0.908s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:45 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 1G Jul 06 12:16:45 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:45 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-7278044d-6648-4947-84e1-c615d2ff2372" released by "delete_volume" :: held 2.165s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_a1n58bc0" returned: 0 in 1.071s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_a1n58bc0 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Created reservations ['affa4d81-1159-4b9e-9abd-1f675c274b96', '5637653b-83cb-4bf7-bf4e-2e00244e7a48', 'd3dafed3-3792-42ec-b41a-d46878eabb44', 'd46f3117-b012-4553-a961-19010129e015'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:45 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_a1n58bc0 Jul 06 12:16:45 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:45 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:45 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:46 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_a1n58bc0" returned: 1 in 0.913s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_a1n58bc0' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9949834-5a3f-4d7e-b257-5674cc0f8c5d]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:46 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.893s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Deleted volume successfully. Jul 06 12:16:46 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD Jul 06 12:16:46 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-040eb90c-b968-4802-9098-90ca57f5aad5 tempest-VolumesGetTest-1460836946 None] Lock "cinder-7278044d-6648-4947-84e1-c615d2ff2372-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:46 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 1G" returned: 0 in 1.373s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:46 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 Jul 06 12:16:46 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:47 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD" returned: 0 in 1.200s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:47 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8" returned: 0 in 0.924s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:47 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 is being set with open permissions: ugo+rw Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:47 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 Jul 06 12:16:47 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:47 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD Jul 06 12:16:47 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (af67245d-f473-4e0d-9096-93bf8544eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6431b7b-da11-4b4e-9ad7-2f9037589898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6431b7b-da11-4b4e-9ad7-2f9037589898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1997422806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13891cfe-7353-417f-bec9-504031a79f7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:48Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2282e5-907a-4b5d-8c6a-6c204d6e3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2282e5-907a-4b5d-8c6a-6c204d6e3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37cc1ff-0be7-4732-b0ce-50bfd8bff878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:47 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37cc1ff-0be7-4732-b0ce-50bfd8bff878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13891cfe-7353-417f-bec9-504031a79f7b', 'volume_name': 'volume-13891cfe-7353-417f-bec9-504031a79f7b', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d9e68-e80e-4f8e-917e-50a2c1f68be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d9e68-e80e-4f8e-917e-50a2c1f68be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8de48d-d7df-401c-9ff9-a1a0e97400b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Volume 13891cfe-7353-417f-bec9-504031a79f7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13891cfe-7353-417f-bec9-504031a79f7b', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Trying to clone 13891cfe-7353-417f-bec9-504031a79f7b from image b501de2b-75f2-48fc-a750-711c22cfabf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:16:48 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD" returned: 1 in 0.993s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 was raw, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:48 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:48 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 Jul 06 12:16:48 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8" returned: 0 in 0.999s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.518s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-902ddd9f-547c-4fb8-bb36-f144e45d26be tempest-VolumesDeleteCascade-319930899 None] Create snapshot completed successfully Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:16:48 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c04ef6-e731-483d-8184-3957110a95aa]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:48 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD Jul 06 12:16:48 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-ced0e319-fe38-4d8a-b593-891681ffebe1-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-ced0e319-fe38-4d8a-b593-891681ffebe1-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Performing cascade delete. {{(pid=86706) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-402e3e74-2539-42cd-87d4-e35739526041-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-402e3e74-2539-42cd-87d4-e35739526041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:49 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482" returned: 0 in 1.220s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71_g04nsgakdevstack@QuobyteHD, size 0.00 MB, duration 1.22 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:16:49 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-402e3e74-2539-42cd-87d4-e35739526041" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-402e3e74-2539-42cd-87d4-e35739526041" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:49 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 1G Jul 06 12:16:49 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Deleting offline snapshot 402e3e74-2539-42cd-87d4-e35739526041 of volume ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] snapshot_file for this snap is: volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b25bb-7aff-4476-b641-58eb0e8a80f9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:49 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 Jul 06 12:16:49 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:49 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD" returned: 0 in 1.151s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:49 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 is fetched for user 226775469bf54b10ba3df343312bfe7f. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65459cc-7c99-4c42-81fc-44b5e754c0b0]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:50 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD Jul 06 12:16:50 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:50 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 1G" returned: 0 in 0.954s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019d2fa-8594-4634-92c2-402172090122]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:50 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 Jul 06 12:16:50 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:50 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041" returned: 0 in 1.037s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced0e319-fe38-4d8a-b593-891681ffebe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6df7cb-8505-4b41-b04d-f74e7c79c64d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:51 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 Jul 06 12:16:51 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:51 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD" returned: 0 in 1.310s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1997422806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13891cfe-7353-417f-bec9-504031a79f7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:48Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Creating volume 13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:51 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:51 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b 1073741824 Jul 06 12:16:51 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:51 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482" returned: 0 in 1.170s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:51 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 Jul 06 12:16:51 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:52 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1" returned: 0 in 1.282s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[19307f18-dac5-40c4-befc-82e469e4add3]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:52 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 Jul 06 12:16:52 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:52 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b 1073741824" returned: 0 in 1.124s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:52 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b Jul 06 12:16:52 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:52 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482" returned: 1 in 0.993s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Downloaded image f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'metadata': {}}])) to volume e1a3a6e2-203e-427a-b089-1abcce2f2482 successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Temporary image f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 for user 9f03df926cb747d2ae629a9ec3a7ba7a is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Marking volume e1a3a6e2-203e-427a-b089-1abcce2f2482 as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Copying metadata from image f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 to e1a3a6e2-203e-427a-b089-1abcce2f2482. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Creating volume glance metadata for volume e1a3a6e2-203e-427a-b089-1abcce2f2482 backed by image f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '065b9095eca4f0488890fcf13c514460', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726f6781-d3bb-4214-b1c4-ad14b8059e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a3a6e2-203e-427a-b089-1abcce2f2482', 'volume_size': 1, 'image_id': 'f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '065b9095eca4f0488890fcf13c514460', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fb7efe6671b4d70b1a4be6eaaf1af30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '100207a243d1b23f69976cdf90a50aa1982824ea860cd5d388fddb7ae749ad5d09fb1ecef9afcde82fcedc84b65264b9c1c2fee6bf4740a9b60ff30a3eb4ce42', 'id': 'f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71', 'created_at': datetime.datetime(2026, 7, 6, 10, 16, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 16, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0fb6aba-bfc5-4593-aec2-d2ccc0bcea71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3b2925-f2ea-47c9-9b42-d3df63d72569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:52 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Volume volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 (e1a3a6e2-203e-427a-b089-1abcce2f2482): created successfully Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3b2925-f2ea-47c9-9b42-d3df63d72569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Flow 'volume_create_manager' (e4128913-878c-466f-b0f1-5ac84fdf4018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:52 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-57b4229a-24d8-4783-ab0e-bb00c6558173 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Created volume successfully. Jul 06 12:16:53 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8" returned: 0 in 0.995s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced0e319-fe38-4d8a-b593-891681ffebe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fac41e-37cb-406f-ba57-fb51e93d4678]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:53 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 Jul 06 12:16:53 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:53 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b" returned: 0 in 0.915s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Attempting download of b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume 13891cfe-7353-417f-bec9-504031a79f7b. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b5d8f-e7a8-460c-afb0-e757d52cd242]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_o1j0_yvw {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:53 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_o1j0_yvw Jul 06 12:16:53 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:54 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041" returned: 0 in 0.933s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced0e319-fe38-4d8a-b593-891681ffebe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fede6fa2-c337-4267-a9c1-4c201d521427]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Acquiring lock "cinder-e1a3a6e2-203e-427a-b089-1abcce2f2482-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "cinder-e1a3a6e2-203e-427a-b089-1abcce2f2482-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:54 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 Jul 06 12:16:54 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Acquiring lock "cinder-quobyte-e1a3a6e2-203e-427a-b089-1abcce2f2482" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "cinder-quobyte-e1a3a6e2-203e-427a-b089-1abcce2f2482" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[769a3450-ff1e-4685-8b6e-6a3cd108849b]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:54 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_o1j0_yvw" returned: 0 in 0.917s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_o1j0_yvw {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:54 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 Jul 06 12:16:54 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:54 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_o1j0_yvw Jul 06 12:16:54 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1" returned: 0 in 1.106s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:55 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 Jul 06 12:16:55 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482" returned: 0 in 0.997s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:55 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_o1j0_yvw" returned: 1 in 0.993s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_o1j0_yvw' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f8862-71d2-4dda-b134-0a62e41fadc9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:55 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 Jul 06 12:16:55 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD Jul 06 12:16:55 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:56 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041" returned: 0 in 1.014s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:56 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041 Jul 06 12:16:56 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:56 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482" returned: 1 in 0.941s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:56 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482 Jul 06 12:16:56 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:56 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD" returned: 0 in 1.016s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] b501de2b-75f2-48fc-a750-711c22cfabf3 was qcow2, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:16:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:56 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b Jul 06 12:16:56 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:57 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.402e3e74-2539-42cd-87d4-e35739526041" returned: 0 in 1.067s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 -F qcow2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:57 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 -F qcow2 Jul 06 12:16:57 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:57 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e1a3a6e2-203e-427a-b089-1abcce2f2482" returned: 0 in 1.093s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "cinder-quobyte-e1a3a6e2-203e-427a-b089-1abcce2f2482" released by "delete_volume" :: held 3.105s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:57 devstack cinder-volume[86706]: WARNING cinder.quota [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:16:57 devstack cinder-volume[86706]: WARNING cinder.quota [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Created reservations ['d28d2ff7-72d1-4505-95dd-13c10090b450', '08baa38b-152a-47ba-b8dd-ff3847853cf6', '7cf324d9-2916-433e-b187-ec0c94bb66e9', 'ad053227-cd41-4d60-a630-cbeabb78a5bd'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:57 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:16:57 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:58 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced0e319-fe38-4d8a-b593-891681ffebe1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 -F qcow2" returned: 0 in 0.961s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-402e3e74-2539-42cd-87d4-e35739526041" released by "_delete_snapshot" :: held 8.724s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" released by "delete_snapshot" :: held 8.767s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Created reservations ['463e3344-edb2-49e7-b0b9-2f284349d749', 'e0c8ec47-3dd5-4625-bdd7-60ae2ff45198', '2f1b2e8a-9682-4aa5-bf51-9785fd203810', '4b8642c4-a829-4984-87c6-ae9807a6c57c'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Delete snapshot completed successfully. Jul 06 12:16:58 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.959s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-402e3e74-2539-42cd-87d4-e35739526041-delete_snapshot" released by "delete_snapshot" :: held 9.096s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-964e0c15-9292-479b-b8ac-1c83e5ecddd8-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Deleted volume successfully. Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-964e0c15-9292-479b-b8ac-1c83e5ecddd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a6735b69-aa53-4296-9e36-45259993fc33 tempest-VolumeAndVolumeTypeFromImageTest-1374256826 None] Lock "cinder-e1a3a6e2-203e-427a-b089-1abcce2f2482-delete_volume" released by "delete_volume" :: held 4.394s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-964e0c15-9292-479b-b8ac-1c83e5ecddd8" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-964e0c15-9292-479b-b8ac-1c83e5ecddd8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Deleting offline snapshot 964e0c15-9292-479b-b8ac-1c83e5ecddd8 of volume ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] snapshot_file for this snap is: volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf4beda-e6ba-48e5-9657-401f8fb40710]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:58 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 Jul 06 12:16:58 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:59 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b" returned: 0 in 3.073s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:59 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_5v5m6zdpdevstack@QuobyteHD, size 112.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:16:59 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Converted 112.00 MB image at 36.44 MB/s Jul 06 12:16:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:59 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b 1G Jul 06 12:16:59 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:59 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8" returned: 0 in 0.949s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced0e319-fe38-4d8a-b593-891681ffebe1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7826c37-b956-4587-a8a3-19e7e30bf75b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:59 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 Jul 06 12:16:59 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:00 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b 1G" returned: 0 in 0.915s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[53badaf7-c980-4fe2-b507-348e8badc302]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:00 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1" returned: 0 in 0.967s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:00 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b Jul 06 12:17:00 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:00 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 Jul 06 12:17:00 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:01 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b" returned: 0 in 1.209s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:01 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:01 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b Jul 06 12:17:01 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8" returned: 0 in 1.251s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:01 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8 Jul 06 12:17:01 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:02 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1.964e0c15-9292-479b-b8ac-1c83e5ecddd8" returned: 0 in 1.073s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-964e0c15-9292-479b-b8ac-1c83e5ecddd8" released by "_delete_snapshot" :: held 4.415s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" released by "delete_snapshot" :: held 4.443s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:03 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b" returned: 1 in 1.346s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Downloaded image b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume 13891cfe-7353-417f-bec9-504031a79f7b successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 for user 226775469bf54b10ba3df343312bfe7f is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Marking volume 13891cfe-7353-417f-bec9-504031a79f7b as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Copying metadata from image b501de2b-75f2-48fc-a750-711c22cfabf3 to 13891cfe-7353-417f-bec9-504031a79f7b. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Creating volume glance metadata for volume 13891cfe-7353-417f-bec9-504031a79f7b backed by image b501de2b-75f2-48fc-a750-711c22cfabf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Created reservations ['6feaf2c9-7cef-40b4-a57c-e9829c9a49a3', '137dea9f-2d26-4b9f-a966-57e84f60d30d', 'fb5c464a-dc29-488f-a35c-0799399b660d', 'e9e1eb29-4f85-4c56-8019-d77dda6ed477'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8de48d-d7df-401c-9ff9-a1a0e97400b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13891cfe-7353-417f-bec9-504031a79f7b', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23da913d-a7da-4170-ae85-cfdf22b3bc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:03 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Volume volume-13891cfe-7353-417f-bec9-504031a79f7b (13891cfe-7353-417f-bec9-504031a79f7b): created successfully Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23da913d-a7da-4170-ae85-cfdf22b3bc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (af67245d-f473-4e0d-9096-93bf8544eafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:03 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-323b58cf-3c50-4d4c-8b0b-39709d7fd53a tempest-VolumesGetTest-1460836946 None] Created volume successfully. Jul 06 12:17:03 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Delete snapshot completed successfully. Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-964e0c15-9292-479b-b8ac-1c83e5ecddd8-delete_snapshot" released by "delete_snapshot" :: held 4.832s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Snapshots deleted, issuing volume delete {{(pid=86706) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5580ef2-c0f0-4ba1-9c6d-6c450c9077eb]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:03 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 Jul 06 12:17:03 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Flow 'volume_create_manager' (968eaa03-5ccd-47cb-9c73-190e2acc0994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af118866-c9ff-4ad2-a3dc-d1e2d5a51257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af118866-c9ff-4ad2-a3dc-d1e2d5a51257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4015677-3e22-41e4-b44f-25c32c97e5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa6ed90b7e74c338c304f10151f41ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:04Z,use_quota=True,user_id='10d2e94fabbd479abe2e3f8d51ed1f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebd04bd-1702-40e6-9e6a-c02398658a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebd04bd-1702-40e6-9e6a-c02398658a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04273d60-b087-43de-a684-017075ec6dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04273d60-b087-43de-a684-017075ec6dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4015677-3e22-41e4-b44f-25c32c97e5fe', 'volume_name': 'volume-a4015677-3e22-41e4-b44f-25c32c97e5fe', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845f50bf-fbb9-46d2-a78b-548070bee054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845f50bf-fbb9-46d2-a78b-548070bee054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17c251d-6628-4d5c-9b7e-da1a82414ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Volume a4015677-3e22-41e4-b44f-25c32c97e5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4015677-3e22-41e4-b44f-25c32c97e5fe', 'volume_size': 1} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4015677-3e22-41e4-b44f-25c32c97e5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa6ed90b7e74c338c304f10151f41ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:04Z,use_quota=True,user_id='10d2e94fabbd479abe2e3f8d51ed1f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Creating volume a4015677-3e22-41e4-b44f-25c32c97e5fe {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:04 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:04 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe 1073741824 Jul 06 12:17:04 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:04 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1" returned: 0 in 1.153s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:04 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1 Jul 06 12:17:04 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (7df4830e-5c18-4daa-82d1-94d51095fca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e742e099-00a9-448a-bbfd-0cfd9c86ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e742e099-00a9-448a-bbfd-0cfd9c86ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-754432784',display_name='tempest-VolumesGetTest-Volume-1346414865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016e4d8c-85a4-45f5-a037-a598bd13c964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:05Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153bcce4-b5a3-4dc4-969d-44cb1ce18e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153bcce4-b5a3-4dc4-969d-44cb1ce18e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32277f0c-f6f4-4e8c-8f7c-61553fbba4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32277f0c-f6f4-4e8c-8f7c-61553fbba4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016e4d8c-85a4-45f5-a037-a598bd13c964', 'volume_name': 'volume-016e4d8c-85a4-45f5-a037-a598bd13c964', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d56fd9-3b0e-4ddf-9640-df0b8ea8464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d56fd9-3b0e-4ddf-9640-df0b8ea8464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e5a8d3-08f9-4ba6-b094-7e4a37886b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:05 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Volume 016e4d8c-85a4-45f5-a037-a598bd13c964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016e4d8c-85a4-45f5-a037-a598bd13c964', 'volume_size': 1} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:05 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced0e319-fe38-4d8a-b593-891681ffebe1" returned: 0 in 0.999s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-ced0e319-fe38-4d8a-b593-891681ffebe1" released by "delete_volume" :: held 2.242s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Created reservations ['903f4a7d-e015-43b7-bcf2-aaa433168a1c', 'fea14fd5-8e31-45a7-a22d-c44c979bd5a1', 'c733f196-0564-4a11-9696-2dd57c062b24', '4e2ba683-de37-4f12-9ec8-d582aea68674'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:05 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe 1073741824" returned: 0 in 1.203s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:05 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:05 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:05 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe Jul 06 12:17:05 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:06 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe" returned: 0 in 0.885s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-754432784',display_name='tempest-VolumesGetTest-Volume-1346414865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016e4d8c-85a4-45f5-a037-a598bd13c964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbef3fcc581544949db89427edf71fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:05Z,use_quota=True,user_id='226775469bf54b10ba3df343312bfe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Creating volume 016e4d8c-85a4-45f5-a037-a598bd13c964 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:06 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:06 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.944s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:06 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 1073741824 Jul 06 12:17:06 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17c251d-6628-4d5c-9b7e-da1a82414ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4015677-3e22-41e4-b44f-25c32c97e5fe', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf4fc7f-f4ef-490a-bc92-89f1e0242e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Deleted volume successfully. Jul 06 12:17:06 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Volume volume-a4015677-3e22-41e4-b44f-25c32c97e5fe (a4015677-3e22-41e4-b44f-25c32c97e5fe): created successfully Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf4fc7f-f4ef-490a-bc92-89f1e0242e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Flow 'volume_create_manager' (968eaa03-5ccd-47cb-9c73-190e2acc0994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4661adff-c278-407d-b58d-c2f20b2587b0 tempest-CinderUnicodeTest-518246456 None] Created volume successfully. Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce59d8dc-d2a2-42e9-b65c-96de5c04ed0d tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-ced0e319-fe38-4d8a-b593-891681ffebe1-delete_volume" released by "delete_volume" :: held 17.586s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Flow 'volume_create_manager' (ca035e08-5ed1-47a9-b2b2-604bec4dd995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284da883-4d81-453d-a412-b97d39431a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284da883-4d81-453d-a412-b97d39431a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-760460830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde77b4f-b385-4b9f-ba83-8ad2675497b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101c642b669445e599093027f21887b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:07Z,use_quota=True,user_id='af55a9ce86564e989337dc6008b1f940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ee4653-a33c-4d90-962b-8b62bd20211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ee4653-a33c-4d90-962b-8b62bd20211c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6a95e-d735-4294-81f3-d52f7123ff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6a95e-d735-4294-81f3-d52f7123ff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde77b4f-b385-4b9f-ba83-8ad2675497b1', 'volume_name': 'volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a406116-1ea6-43a1-b130-2e37bf3aa3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a406116-1ea6-43a1-b130-2e37bf3aa3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3767ed33-cff2-45b5-b17d-1aa0eef69e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:06 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Volume bde77b4f-b385-4b9f-ba83-8ad2675497b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1', 'volume_size': 1} Jul 06 12:17:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:07 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 1073741824" returned: 0 in 1.111s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:07 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 Jul 06 12:17:07 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Flow 'volume_create_manager' (4bd0ae28-bab2-404b-a312-f4bf06678b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d029a1-d4a8-428b-9fed-804642173df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d029a1-d4a8-428b-9fed-804642173df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1162478133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58aa0893-b28e-42db-bb71-22419b446563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa6ed90b7e74c338c304f10151f41ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:08Z,use_quota=True,user_id='10d2e94fabbd479abe2e3f8d51ed1f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84b778d-ea67-4443-a055-f86c17c156b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84b778d-ea67-4443-a055-f86c17c156b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef13459a-814c-445e-bb1e-6009a91ef179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef13459a-814c-445e-bb1e-6009a91ef179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58aa0893-b28e-42db-bb71-22419b446563', 'volume_name': 'volume-58aa0893-b28e-42db-bb71-22419b446563', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e665bcba-f436-4408-9e01-7bd89a48b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e665bcba-f436-4408-9e01-7bd89a48b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd79b46f-443e-422b-9d5d-824a2a1b97eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:08 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Volume 58aa0893-b28e-42db-bb71-22419b446563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58aa0893-b28e-42db-bb71-22419b446563', 'volume_size': 1} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:08 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964" returned: 0 in 0.773s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-760460830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde77b4f-b385-4b9f-ba83-8ad2675497b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101c642b669445e599093027f21887b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:07Z,use_quota=True,user_id='af55a9ce86564e989337dc6008b1f940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Creating volume bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:08 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:08 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 1073741824 Jul 06 12:17:08 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e5a8d3-08f9-4ba6-b094-7e4a37886b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016e4d8c-85a4-45f5-a037-a598bd13c964', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faf4adb-87c1-4d7a-bb4f-c7e58e228964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:08 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Volume volume-016e4d8c-85a4-45f5-a037-a598bd13c964 (016e4d8c-85a4-45f5-a037-a598bd13c964): created successfully Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faf4adb-87c1-4d7a-bb4f-c7e58e228964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Flow 'volume_create_manager' (7df4830e-5c18-4daa-82d1-94d51095fca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8ddfea39-0ace-43db-a5f3-0976837efb25 tempest-VolumesGetTest-1460836946 None] Created volume successfully. Jul 06 12:17:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-016e4d8c-85a4-45f5-a037-a598bd13c964-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Lock "cinder-016e4d8c-85a4-45f5-a037-a598bd13c964-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-016e4d8c-85a4-45f5-a037-a598bd13c964" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-016e4d8c-85a4-45f5-a037-a598bd13c964" acquired by "delete_volume" :: waited 0.034s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:09 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fcc2be-f22d-4cdc-a9c9-c2de0e6e7458]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:10 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 Jul 06 12:17:10 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:10 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 1073741824" returned: 0 in 1.481s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:10 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 Jul 06 12:17:10 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:10 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964" returned: 0 in 0.988s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:10 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964 Jul 06 12:17:10 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:10 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1" returned: 0 in 0.745s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.675s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1162478133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58aa0893-b28e-42db-bb71-22419b446563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa6ed90b7e74c338c304f10151f41ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:08Z,use_quota=True,user_id='10d2e94fabbd479abe2e3f8d51ed1f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Creating volume 58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:11 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:11 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 1073741824 Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3767ed33-cff2-45b5-b17d-1aa0eef69e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:11 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc25bcec-6ded-4b60-9dd9-41248cf8d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:11 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Volume volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 (bde77b4f-b385-4b9f-ba83-8ad2675497b1): created successfully Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc25bcec-6ded-4b60-9dd9-41248cf8d69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Flow 'volume_create_manager' (ca035e08-5ed1-47a9-b2b2-604bec4dd995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d549aa42-edc1-4c9d-9dfc-939bf7b44143 tempest-VolumesDeleteCascade-319930899 None] Created volume successfully. Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:11 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-016e4d8c-85a4-45f5-a037-a598bd13c964" returned: 0 in 0.918s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-016e4d8c-85a4-45f5-a037-a598bd13c964" released by "delete_volume" :: held 1.994s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Created reservations ['ac102d8e-b7b3-4e84-a3af-0ad42829465d', '41d4fd53-191d-4635-8098-6910966f5f41', 'a6344e59-377f-473e-b279-7fa09ce135f8', '41545ad8-e175-43b7-99b0-776c203f6b6d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:12 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:12 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-13891cfe-7353-417f-bec9-504031a79f7b-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Lock "cinder-13891cfe-7353-417f-bec9-504031a79f7b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Acquiring lock "cinder-quobyte-13891cfe-7353-417f-bec9-504031a79f7b" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-13891cfe-7353-417f-bec9-504031a79f7b" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:12 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 1073741824" returned: 0 in 1.375s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5d0a91-910c-4735-8883-ea4d1391d8cb]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:12 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 Jul 06 12:17:12 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:12 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b Jul 06 12:17:12 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:12 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.951s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Deleted volume successfully. Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f5b64966-d6f7-40ce-a944-471b316792e1 tempest-VolumesGetTest-1460836946 None] Lock "cinder-016e4d8c-85a4-45f5-a037-a598bd13c964-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:13 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b" returned: 0 in 1.109s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:13 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563" returned: 0 in 1.153s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] <== create_volume: return (2593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.597s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Creating offline snapshot 84fb5062-e397-4175-bdfe-2d0ac7882985 of volume bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd79b46f-443e-422b-9d5d-824a2a1b97eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58aa0893-b28e-42db-bb71-22419b446563', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4d96f2-221e-4762-8b35-da487b623754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d7d7e1-30f4-486a-9d2b-dfc728b47b44]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:13 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Volume volume-58aa0893-b28e-42db-bb71-22419b446563 (58aa0893-b28e-42db-bb71-22419b446563): created successfully Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4d96f2-221e-4762-8b35-da487b623754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Flow 'volume_create_manager' (4bd0ae28-bab2-404b-a312-f4bf06678b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9fd82803-a749-4e1c-8014-799f12105c86 tempest-CinderUnicodeTest-518246456 None] Created volume successfully. Jul 06 12:17:13 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b Jul 06 12:17:13 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:13 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 Jul 06 12:17:13 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:14 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b" returned: 1 in 1.051s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:17:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:14 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b Jul 06 12:17:14 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:14 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1" returned: 0 in 1.091s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:14 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 1G Jul 06 12:17:14 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:15 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-13891cfe-7353-417f-bec9-504031a79f7b" returned: 0 in 1.212s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Lock "cinder-quobyte-13891cfe-7353-417f-bec9-504031a79f7b" released by "delete_volume" :: held 3.475s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:15 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Created reservations ['741f550d-4c95-47a4-a015-92b901767e82', '6bfb64be-da64-40fb-bec3-a76700369c93', '6100609b-73a9-498c-b80a-e199ce8528a0', '97508c8c-00e5-48eb-9b82-dd1a8dca410b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:16 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:16 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:16 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 1G" returned: 0 in 1.401s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:16 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 Jul 06 12:17:16 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:16 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.972s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:17 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Deleted volume successfully. Jul 06 12:17:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a2e8f4d-8210-4d44-b614-ab1dc0471e06 tempest-VolumesGetTest-1460836946 None] Lock "cinder-13891cfe-7353-417f-bec9-504031a79f7b-delete_volume" released by "delete_volume" :: held 4.754s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:17 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985" returned: 0 in 1.003s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:17 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 is being set with open permissions: ugo+rw Jul 06 12:17:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:17 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 Jul 06 12:17:17 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:18 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985" returned: 0 in 0.943s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:18 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.info Jul 06 12:17:18 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:18 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.info" returned: 0 in 0.845s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:18 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.info is being set with open permissions: ugo+rw Jul 06 12:17:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:19 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.info Jul 06 12:17:19 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:19 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.info" returned: 0 in 0.715s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.131s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Creating offline snapshot d917b358-750a-4754-8de5-fe52b6714946 of volume 58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:19 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-dddcf415-1eda-4e81-a38e-052780a07639 tempest-VolumesDeleteCascade-319930899 None] Create snapshot completed successfully Jul 06 12:17:19 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[655f2385-a2b1-4e12-9d53-3e59ab805476]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:19 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 Jul 06 12:17:19 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:20 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563" returned: 0 in 1.142s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:21 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 1G Jul 06 12:17:21 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Flow 'volume_create_manager' (34981a76-42b2-4028-8c23-b989d23ec4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e299533-aeda-438b-a64c-79f511914518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e299533-aeda-438b-a64c-79f511914518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-233551141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101c642b669445e599093027f21887b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=84fb5062-e397-4175-bdfe-2d0ac7882985,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:21Z,use_quota=True,user_id='af55a9ce86564e989337dc6008b1f940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf2ece5-1c8b-437a-b27b-01a09118a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf2ece5-1c8b-437a-b27b-01a09118a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c33715-92ca-4bfa-a838-bc0e88da1bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c33715-92ca-4bfa-a838-bc0e88da1bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f', 'volume_name': 'volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f', 'volume_size': 1, 'snapshot_id': '84fb5062-e397-4175-bdfe-2d0ac7882985'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2273ed-86fc-4e62-9b43-1b209e0a720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2273ed-86fc-4e62-9b43-1b209e0a720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de22a63-f8b7-4c89-a1f7-b3216ec306a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:21 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Volume fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f', 'volume_size': 1, 'snapshot_id': '84fb5062-e397-4175-bdfe-2d0ac7882985'} Jul 06 12:17:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:22 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 1G" returned: 0 in 1.064s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58aa0893-b28e-42db-bb71-22419b446563 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:22 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58aa0893-b28e-42db-bb71-22419b446563 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 Jul 06 12:17:22 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:22 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58aa0893-b28e-42db-bb71-22419b446563 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946" returned: 0 in 0.764s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:22 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 is being set with open permissions: ugo+rw Jul 06 12:17:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:22 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 Jul 06 12:17:22 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:23 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946" returned: 0 in 0.766s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:23 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.info Jul 06 12:17:23 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:24 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.info" returned: 0 in 0.759s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:24 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.info is being set with open permissions: ugo+rw Jul 06 12:17:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:24 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.info Jul 06 12:17:24 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:25 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.info" returned: 0 in 0.847s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.501s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.094s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-84fb5062-e397-4175-bdfe-2d0ac7882985-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-67846000-9fbe-4092-9df1-5ffa460ceca6 tempest-CinderUnicodeTest-518246456 None] Create snapshot completed successfully Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-84fb5062-e397-4175-bdfe-2d0ac7882985-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Creating volume fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f from snapshot 84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] snapshot: 84fb5062-e397-4175-bdfe-2d0ac7882985, volume: fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121bf88-bdef-4e25-a44b-b47b1adc4efa]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:25 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 Jul 06 12:17:25 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "cinder-d917b358-750a-4754-8de5-fe52b6714946-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-d917b358-750a-4754-8de5-fe52b6714946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "cinder-quobyte-58aa0893-b28e-42db-bb71-22419b446563" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-58aa0893-b28e-42db-bb71-22419b446563" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "cinder-quobyte-d917b358-750a-4754-8de5-fe52b6714946" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-d917b358-750a-4754-8de5-fe52b6714946" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Deleting offline snapshot d917b358-750a-4754-8de5-fe52b6714946 of volume 58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:17:26 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] snapshot_file for this snap is: volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985" returned: 0 in 1.061s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75b39f5-f37c-499d-a1da-5015f76e0a7b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9987a8-64cf-4908-bb64-71dbd907eb52]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:26 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 Jul 06 12:17:26 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:26 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 Jul 06 12:17:26 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:27 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:27 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:27 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:27 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946" returned: 0 in 1.016s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58aa0893-b28e-42db-bb71-22419b446563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1" returned: 0 in 1.024s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf4a0ba-a5d8-4e97-b650-8ef03bf2e2aa]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:27 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f Jul 06 12:17:27 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:27 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 Jul 06 12:17:27 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:28 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.028s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:17:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:17:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:17:28 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563" returned: 0 in 0.944s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:28 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 Jul 06 12:17:28 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:30 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946" returned: 0 in 2.177s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:30 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946 Jul 06 12:17:30 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:32 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563.d917b358-750a-4754-8de5-fe52b6714946" returned: 0 in 1.785s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:32 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=99,cinder:INSERT=35,cinder:DELETE=12,cinder:SELECT=84 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:17:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-d917b358-750a-4754-8de5-fe52b6714946" released by "_delete_snapshot" :: held 6.204s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-58aa0893-b28e-42db-bb71-22419b446563" released by "delete_snapshot" :: held 6.265s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:32 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Created reservations ['64224881-9829-4e5b-a106-6ce26425c5c5', '26f72119-54ea-46fe-9d0b-49d9e0748a72', 'ca407db8-faef-487d-8919-2e156d680a26', '5e5e55d2-8baa-4016-ae99-1187983c089d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:32 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Delete snapshot completed successfully. Jul 06 12:17:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-929f8cc4-bf4c-4a11-89c1-788ab6b95032 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-d917b358-750a-4754-8de5-fe52b6714946-delete_snapshot" released by "delete_snapshot" :: held 6.589s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Acquiring lock "cinder-58aa0893-b28e-42db-bb71-22419b446563-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Lock "cinder-58aa0893-b28e-42db-bb71-22419b446563-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Acquiring lock "cinder-quobyte-58aa0893-b28e-42db-bb71-22419b446563" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-58aa0893-b28e-42db-bb71-22419b446563" acquired by "delete_volume" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:33 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[91efb756-2166-42b3-a0dd-5db08567b94f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:33 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 Jul 06 12:17:33 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:34 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" returned: 0 in 6.941s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:34 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7804a2-b976-48d6-99ad-dc4f3921da83]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:34 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 Jul 06 12:17:34 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:34 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563" returned: 0 in 1.374s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:34 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563 Jul 06 12:17:34 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:35 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-58aa0893-b28e-42db-bb71-22419b446563" returned: 0 in 0.754s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-58aa0893-b28e-42db-bb71-22419b446563" released by "delete_volume" :: held 2.268s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=99,cinder:UPDATE=108,cinder:INSERT=37,cinder:DELETE=7 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:17:35 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1" returned: 0 in 1.210s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:17:35 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Converted 1024.00 MB image at 147.46 MB/s Jul 06 12:17:35 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f is being set with open permissions: ugo+rw Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:35 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f Jul 06 12:17:35 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Created reservations ['47cf7664-5b8d-44cc-8bcb-9d2b0fc1d60e', '2ae267ab-bc09-49a2-9061-0a272524dfe4', 'bdf83f22-4bfa-492f-b867-03c0fddfde89', 'fc9a66e5-aaa6-4174-a9e8-aa80e7ec60c9'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:35 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:35 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:36 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" returned: 0 in 0.930s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" released by "_copy_volume_from_snapshot" :: held 11.355s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-84fb5062-e397-4175-bdfe-2d0ac7882985-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" released by "_create_volume_from_snapshot" :: held 11.410s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.455s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de22a63-f8b7-4c89-a1f7-b3216ec306a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f', 'volume_size': 1, 'snapshot_id': '84fb5062-e397-4175-bdfe-2d0ac7882985'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c81a93-cff4-450d-a705-25dbdf956420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Volume volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f (fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f): created successfully Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c81a93-cff4-450d-a705-25dbdf956420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Flow 'volume_create_manager' (34981a76-42b2-4028-8c23-b989d23ec4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-aa364fdd-f845-4227-96f1-a283bc65501a tempest-VolumesDeleteCascade-319930899 None] Created volume successfully. Jul 06 12:17:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "cinder-a4015677-3e22-41e4-b44f-25c32c97e5fe-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:37 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.097s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-a4015677-3e22-41e4-b44f-25c32c97e5fe-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Deleted volume successfully. Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-89c70cd7-0e82-4c64-ad72-0a868050fb8f tempest-CinderUnicodeTest-518246456 None] Lock "cinder-58aa0893-b28e-42db-bb71-22419b446563-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "cinder-quobyte-a4015677-3e22-41e4-b44f-25c32c97e5fe" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-a4015677-3e22-41e4-b44f-25c32c97e5fe" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b74198-7ab7-41b4-b21d-c2078166492a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:37 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe Jul 06 12:17:37 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Flow 'volume_create_manager' (2c95b0e0-a429-4038-95a1-f168835ebfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dc19ac-76fc-47a0-82a7-28b5dd4848db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11dc19ac-76fc-47a0-82a7-28b5dd4848db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-871701280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8523f481-7964-42f6-9ae7-03a97c746429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ef04ce9a341acaf2611607a4ba3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:38Z,use_quota=True,user_id='326337e419084c6488680f3c9adf5410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f042c12a-d1bf-4e33-8d40-f7b4e7794603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f042c12a-d1bf-4e33-8d40-f7b4e7794603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed43d14c-cbc7-417b-b991-5d84ff367e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed43d14c-cbc7-417b-b991-5d84ff367e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8523f481-7964-42f6-9ae7-03a97c746429', 'volume_name': 'volume-8523f481-7964-42f6-9ae7-03a97c746429', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9109dc-d774-4259-8356-6379e32e4e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9109dc-d774-4259-8356-6379e32e4e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf0e2ca-8e3d-4914-b25d-74b791864ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:37 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Volume 8523f481-7964-42f6-9ae7-03a97c746429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8523f481-7964-42f6-9ae7-03a97c746429', 'volume_size': 1} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-871701280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8523f481-7964-42f6-9ae7-03a97c746429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701ef04ce9a341acaf2611607a4ba3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:38Z,use_quota=True,user_id='326337e419084c6488680f3c9adf5410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Creating volume 8523f481-7964-42f6-9ae7-03a97c746429 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:37 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:37 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 1073741824 Jul 06 12:17:37 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-bde77b4f-b385-4b9f-ba83-8ad2675497b1-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-bde77b4f-b385-4b9f-ba83-8ad2675497b1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:38 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe" returned: 0 in 1.030s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:38 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe Jul 06 12:17:38 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Performing cascade delete. {{(pid=86706) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-84fb5062-e397-4175-bdfe-2d0ac7882985-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-84fb5062-e397-4175-bdfe-2d0ac7882985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-bde77b4f-b385-4b9f-ba83-8ad2675497b1" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-bde77b4f-b385-4b9f-ba83-8ad2675497b1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-84fb5062-e397-4175-bdfe-2d0ac7882985" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-84fb5062-e397-4175-bdfe-2d0ac7882985" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Deleting offline snapshot 84fb5062-e397-4175-bdfe-2d0ac7882985 of volume bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] snapshot_file for this snap is: volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4669d2a-3d90-421b-820d-53db4d8ff2ae]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (01e32c0a-6c57-4924-99be-ffbf53edbb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87ec781-b667-437a-8bc6-83aa8b953cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87ec781-b667-437a-8bc6-83aa8b953cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1685745643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b492ab-15a2-4d9b-9210-dd37647e759b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:38Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c354594-99d4-4d0d-b5a3-93eac6c2c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c354594-99d4-4d0d-b5a3-93eac6c2c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73958a54-dc87-4957-9439-bf1baa3ad538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73958a54-dc87-4957-9439-bf1baa3ad538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b492ab-15a2-4d9b-9210-dd37647e759b', 'volume_name': 'volume-52b492ab-15a2-4d9b-9210-dd37647e759b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 Jul 06 12:17:38 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83dfcea-8993-4335-a9a5-a270d77945b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83dfcea-8993-4335-a9a5-a270d77945b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047deba5-e43b-405c-ad85-2602ac7f849a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:38 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Volume 52b492ab-15a2-4d9b-9210-dd37647e759b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b492ab-15a2-4d9b-9210-dd37647e759b', 'volume_size': 1} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:38 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a4015677-3e22-41e4-b44f-25c32c97e5fe" returned: 0 in 0.770s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:38 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 1073741824" returned: 0 in 1.214s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-quobyte-a4015677-3e22-41e4-b44f-25c32c97e5fe" released by "delete_volume" :: held 1.860s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:39 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 Jul 06 12:17:39 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Created reservations ['07940a83-a007-4e53-a4a3-f95ed51b244f', 'aae03529-f9ff-4eee-a237-f9f675da8a95', '1a2a5f1e-2b78-42f0-8df5-ebe1eb3629ed', '296844ae-6885-43d8-9925-a8795d4d0318'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:39 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:39 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:39 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985" returned: 0 in 0.999s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb287fb3-93ec-4c14-8c3d-5288b5a1a366]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:39 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 Jul 06 12:17:39 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:39 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429" returned: 0 in 0.799s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1685745643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b492ab-15a2-4d9b-9210-dd37647e759b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:38Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Creating volume 52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:39 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf0e2ca-8e3d-4914-b25d-74b791864ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8523f481-7964-42f6-9ae7-03a97c746429', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:39 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b 1073741824 Jul 06 12:17:39 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208c0e06-aaf7-4621-b1dc-ccbbfefd922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:39 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Volume volume-8523f481-7964-42f6-9ae7-03a97c746429 (8523f481-7964-42f6-9ae7-03a97c746429): created successfully Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208c0e06-aaf7-4621-b1dc-ccbbfefd922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Flow 'volume_create_manager' (2c95b0e0-a429-4038-95a1-f168835ebfce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3e515c76-d447-4110-8bb5-0703d747137a tempest-AttachVolumeShelveTestJSON-1094234177 None] Created volume successfully. Jul 06 12:17:40 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.861s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:40 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:40 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Deleted volume successfully. Jul 06 12:17:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-993eefbc-2b3e-4ea3-b8bd-52820dc3a7f1 tempest-CinderUnicodeTest-518246456 None] Lock "cinder-a4015677-3e22-41e4-b44f-25c32c97e5fe-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:40 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1" returned: 0 in 1.153s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:40 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 Jul 06 12:17:40 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:41 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b 1073741824" returned: 0 in 1.227s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:41 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b Jul 06 12:17:41 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:41 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985" returned: 0 in 0.983s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:41 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985 Jul 06 12:17:41 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:41 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b" returned: 0 in 0.833s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047deba5-e43b-405c-ad85-2602ac7f849a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b492ab-15a2-4d9b-9210-dd37647e759b', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506f8654-39bf-40fd-9181-36f95ce5fce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:42 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Volume volume-52b492ab-15a2-4d9b-9210-dd37647e759b (52b492ab-15a2-4d9b-9210-dd37647e759b): created successfully Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506f8654-39bf-40fd-9181-36f95ce5fce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (01e32c0a-6c57-4924-99be-ffbf53edbb79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e544e59e-2805-49c2-9bb7-96c66d2665ed tempest-VolumesSnapshotTestJSON-1380866723 None] Created volume successfully. Jul 06 12:17:42 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1.84fb5062-e397-4175-bdfe-2d0ac7882985" returned: 0 in 0.869s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-84fb5062-e397-4175-bdfe-2d0ac7882985" released by "_delete_snapshot" :: held 4.143s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-bde77b4f-b385-4b9f-ba83-8ad2675497b1" released by "delete_snapshot" :: held 4.177s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Created reservations ['e1a2909b-d6bd-4be4-8abe-49e1ebe4e326', '4a835d5c-f54e-4396-a1ba-251e389a77ae', '625006dd-75f0-4671-a5ff-5bc9a32cec8d', '43b18526-c64a-4af9-bf52-38b92ee2e589'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Delete snapshot completed successfully. Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-84fb5062-e397-4175-bdfe-2d0ac7882985-delete_snapshot" released by "delete_snapshot" :: held 4.421s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Snapshots deleted, issuing volume delete {{(pid=86706) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-bde77b4f-b385-4b9f-ba83-8ad2675497b1" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-bde77b4f-b385-4b9f-ba83-8ad2675497b1" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2667fa9e-92ed-4298-9203-bbf6e8b20634]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:43 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 Jul 06 12:17:43 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Creating offline snapshot 695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 of volume 52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:43 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[37695515-67b5-4a10-8e90-8185e90faeb0]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:43 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b Jul 06 12:17:43 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1" returned: 0 in 1.265s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:44 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1 Jul 06 12:17:44 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b" returned: 0 in 0.974s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:44 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 1G Jul 06 12:17:44 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bde77b4f-b385-4b9f-ba83-8ad2675497b1" returned: 0 in 0.870s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-bde77b4f-b385-4b9f-ba83-8ad2675497b1" released by "delete_volume" :: held 2.246s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Created reservations ['80200d31-21ed-4de4-9a52-3bbcd3fd6d1a', '88b176e2-c85b-4389-a0ec-9926eee887af', '4efd7db7-2174-4815-8270-10c40b8b4083', '139fb1b1-5ae7-4909-b1ae-f78e0fc39aa3'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:45 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:45 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:45 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 1G" returned: 0 in 1.040s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b492ab-15a2-4d9b-9210-dd37647e759b -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:45 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b492ab-15a2-4d9b-9210-dd37647e759b -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 Jul 06 12:17:45 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "cinder-quobyte-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:46 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.990s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Deleted volume successfully. Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[192aa9eb-4ec0-4c69-a063-c92cb77b1164]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10cc48b6-fadc-4831-9cd6-aebc79943c38 tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-bde77b4f-b385-4b9f-ba83-8ad2675497b1-delete_volume" released by "delete_volume" :: held 8.096s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:46 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b492ab-15a2-4d9b-9210-dd37647e759b -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" returned: 0 in 0.954s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:46 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 is being set with open permissions: ugo+rw Jul 06 12:17:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:46 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f Jul 06 12:17:46 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:46 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 Jul 06 12:17:46 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:47 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" returned: 0 in 0.998s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:47 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" returned: 0 in 1.132s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:47 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f Jul 06 12:17:47 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:47 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.info Jul 06 12:17:47 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:48 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" returned: 0 in 0.948s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-quobyte-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f" released by "delete_volume" :: held 2.162s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Created reservations ['d505e587-e09a-4ef7-a4d9-f6a758b63640', '7ffdb159-3df7-4c10-8fc0-104323025e34', '4dcc3900-3013-4728-8c56-a0ecb3b92950', 'ccc92f5d-2144-4bcd-947a-4104a3658afa'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:48 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.info" returned: 0 in 1.158s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:48 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.info is being set with open permissions: ugo+rw Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:48 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.info Jul 06 12:17:48 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:48 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:17:48 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:49 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.689s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:49 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Deleted volume successfully. Jul 06 12:17:49 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.info" returned: 0 in 0.780s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.064s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9e001154-d9f4-49c8-b1d4-42ead76dcefd tempest-VolumesDeleteCascade-319930899 None] Lock "cinder-fc6c2c0b-9f1f-4f16-96ce-97db2efb6b4f-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9c64018e-1616-4a54-a00a-5eec46f88f0c tempest-VolumesSnapshotTestJSON-1380866723 None] Create snapshot completed successfully Jul 06 12:17:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-52b492ab-15a2-4d9b-9210-dd37647e759b" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-52b492ab-15a2-4d9b-9210-dd37647e759b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Deleting offline snapshot 695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 of volume 52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] snapshot_file for this snap is: volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[76963adb-281f-416d-bf8b-325b95e5889b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:50 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 Jul 06 12:17:50 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:51 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" returned: 0 in 1.143s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b492ab-15a2-4d9b-9210-dd37647e759b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375767c-6a0a-4ef1-a505-a3f2a2a42c90]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:51 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b Jul 06 12:17:51 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:52 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b" returned: 0 in 0.924s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:52 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 Jul 06 12:17:52 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:53 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" returned: 0 in 0.840s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:53 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9 Jul 06 12:17:53 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:53 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b.695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" returned: 0 in 0.804s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9" released by "_delete_snapshot" :: held 3.893s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-52b492ab-15a2-4d9b-9210-dd37647e759b" released by "delete_snapshot" :: held 3.928s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:54 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['52b5333e-3dfb-41ad-873e-4e89ea221ddf', '56b1c2e0-fe59-4019-a794-26640d1ff138', '11a48131-cb8d-46a8-899a-1ae4e68abfc6', '92822728-9055-4989-8d4c-3ebab6d64768'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:54 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Delete snapshot completed successfully. Jul 06 12:17:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d4ac2f2f-0d62-4d93-b036-99944f6efdb8 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-695e1ee9-a4a7-4081-9c5c-a3f3ec2be8f9-delete_snapshot" released by "delete_snapshot" :: held 4.159s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:54 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (53cadd0f-c236-4372-a482-3b4ae2ef8c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f227c5-141b-4ebf-b6b1-94b27c34a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f227c5-141b-4ebf-b6b1-94b27c34a7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1908796102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:55Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b29e2fb-7c64-4a93-bfa5-4110d8180c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b29e2fb-7c64-4a93-bfa5-4110d8180c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a535a57f-77b6-4cbb-b90f-a20797e45c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a535a57f-77b6-4cbb-b90f-a20797e45c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c', 'volume_name': 'volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf88d2b-21af-48df-92e1-cbd475171c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf88d2b-21af-48df-92e1-cbd475171c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1609cf69-edb2-4da1-a5da-9e39b20ca6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume 12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c', 'volume_size': 1} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1908796102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:55Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating volume 12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:55 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:55 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c 1073741824 Jul 06 12:17:55 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Flow 'volume_create_manager' (f357781d-d747-44a8-9761-2e6b8d2c8515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8b8094-ec4a-4193-937f-0ed88fcff730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8b8094-ec4a-4193-937f-0ed88fcff730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1263656886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e253581a-42a1-4d3a-95d3-db4cdb11e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406dfab06f0d4e87ab8fe575ae65afc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:55Z,use_quota=True,user_id='71b5367c71554655ac7f27c79ed38859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddc773d-4ad9-4b40-b0b8-55ba6d931f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddc773d-4ad9-4b40-b0b8-55ba6d931f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bab2f71-8cc9-4cba-9549-c92fdfd5d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bab2f71-8cc9-4cba-9549-c92fdfd5d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e253581a-42a1-4d3a-95d3-db4cdb11e569', 'volume_name': 'volume-e253581a-42a1-4d3a-95d3-db4cdb11e569', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b371f76-7654-4acd-afaf-5e29372624a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b371f76-7654-4acd-afaf-5e29372624a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a9a8a8-7596-4a69-b4dd-27ec12ca23ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Volume e253581a-42a1-4d3a-95d3-db4cdb11e569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e253581a-42a1-4d3a-95d3-db4cdb11e569', 'volume_size': 1} Jul 06 12:17:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:56 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c 1073741824" returned: 0 in 1.220s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:56 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c Jul 06 12:17:56 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:57 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" returned: 0 in 0.784s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.748s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1263656886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e253581a-42a1-4d3a-95d3-db4cdb11e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406dfab06f0d4e87ab8fe575ae65afc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:55Z,use_quota=True,user_id='71b5367c71554655ac7f27c79ed38859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Creating volume e253581a-42a1-4d3a-95d3-db4cdb11e569 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:57 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1609cf69-edb2-4da1-a5da-9e39b20ca6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:57 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 1073741824 Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33c7ee1-d31b-47ad-8b33-c83a0d94a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:57 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c (12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c): created successfully Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33c7ee1-d31b-47ad-8b33-c83a0d94a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (53cadd0f-c236-4372-a482-3b4ae2ef8c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-69459ba8-d962-40a8-8498-4d31d2ee9770 tempest-VolumesSnapshotTestJSON-1380866723 None] Created volume successfully. Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9a3e1141-f620-4711-8bca-71b68c7acb20 req-3c8a9f3a-77b9-40e1-bbcf-8d3ebcbf06ad tempest-AttachVolumeShelveTestJSON-1094234177 None] No connector for attachment c0ccee8b-436d-4d2e-b297-9f77831724d7; skipping storage backend terminate_connection call. {{(pid=86706) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 12:17:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9a3e1141-f620-4711-8bca-71b68c7acb20 req-3c8a9f3a-77b9-40e1-bbcf-8d3ebcbf06ad tempest-AttachVolumeShelveTestJSON-1094234177 None] Deleting attachment c0ccee8b-436d-4d2e-b297-9f77831724d7. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:17:58 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 1073741824" returned: 0 in 1.071s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:58 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 Jul 06 12:17:58 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:59 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569" returned: 0 in 0.843s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.768s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating offline snapshot 6909ae65-d9da-4bd9-9537-02af9da51044 of volume 12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a9a8a8-7596-4a69-b4dd-27ec12ca23ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e253581a-42a1-4d3a-95d3-db4cdb11e569', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba41447e-adbc-4071-866e-710b72838277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1ccb33-5903-4ea8-b0f1-102ab923de30]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:59 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Volume volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 (e253581a-42a1-4d3a-95d3-db4cdb11e569): created successfully Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba41447e-adbc-4071-866e-710b72838277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Flow 'volume_create_manager' (f357781d-d747-44a8-9761-2e6b8d2c8515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1cf54020-087d-4317-ac74-84d4b345a403 tempest-VolumesTransfersV355Test-1633219309 None] Created volume successfully. Jul 06 12:17:59 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c Jul 06 12:17:59 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:00 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" returned: 0 in 0.978s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:00 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 1G Jul 06 12:18:00 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-bd6b5f28-66c3-4559-9e5f-cd4831dfa649 tempest-VolumesTransfersV355Test-1344806816 None] Transfer volume completed successfully. Jul 06 12:18:01 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 1G" returned: 0 in 0.933s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:01 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 Jul 06 12:18:01 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Acquiring lock "cinder-e253581a-42a1-4d3a-95d3-db4cdb11e569-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-e253581a-42a1-4d3a-95d3-db4cdb11e569-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Acquiring lock "cinder-quobyte-e253581a-42a1-4d3a-95d3-db4cdb11e569" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-quobyte-e253581a-42a1-4d3a-95d3-db4cdb11e569" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[49835f75-0b43-4414-9b62-cc10412c86f5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:01 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 Jul 06 12:18:01 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:02 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044" returned: 0 in 1.012s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:02 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 is being set with open permissions: ugo+rw Jul 06 12:18:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:02 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 Jul 06 12:18:02 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:02 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569" returned: 0 in 0.922s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:02 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569 Jul 06 12:18:02 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:03 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044" returned: 0 in 1.004s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:03 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.info Jul 06 12:18:03 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:03 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e253581a-42a1-4d3a-95d3-db4cdb11e569" returned: 0 in 0.810s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-quobyte-e253581a-42a1-4d3a-95d3-db4cdb11e569" released by "delete_volume" :: held 1.786s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Created reservations ['08184924-6621-40e7-a308-316fcc3c9472', '01a39dfb-dbcd-424d-873b-92186e52c3a2', 'bc38e2f2-7f90-4ddf-bf8f-cbc5cf7e543e', 'aae0c8d3-3355-4bb0-b991-15fefcd1aa8d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:03 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:03 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:04 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.info" returned: 0 in 0.912s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:04 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.info is being set with open permissions: ugo+rw Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:04 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.info Jul 06 12:18:04 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:04 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.815s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:04 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Deleted volume successfully. Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-793cea7e-5d2b-40c6-bf83-d9d2bfd8f653 tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-e253581a-42a1-4d3a-95d3-db4cdb11e569-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Flow 'volume_create_manager' (6a2d02fa-29b7-41a2-bee7-e2752b9fc9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39afd19f-afee-4cba-aa71-4b327a088a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39afd19f-afee-4cba-aa71-4b327a088a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1671680491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52789dbb-05d6-49fe-8b0c-1de61b4274c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406dfab06f0d4e87ab8fe575ae65afc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:04Z,use_quota=True,user_id='71b5367c71554655ac7f27c79ed38859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a7b12-db76-40d4-a221-b24cd4222a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a7b12-db76-40d4-a221-b24cd4222a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4611d57-77c7-4151-845d-5a17370dbbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4611d57-77c7-4151-845d-5a17370dbbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52789dbb-05d6-49fe-8b0c-1de61b4274c5', 'volume_name': 'volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386e61d5-ea5c-47f7-a3f7-fa6efe4d0c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386e61d5-ea5c-47f7-a3f7-fa6efe4d0c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be88b74-72cb-40ad-a7c7-c42a94680f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Volume 52789dbb-05d6-49fe-8b0c-1de61b4274c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5', 'volume_size': 1} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:04 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.info" returned: 0 in 0.878s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.848s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1671680491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52789dbb-05d6-49fe-8b0c-1de61b4274c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406dfab06f0d4e87ab8fe575ae65afc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:04Z,use_quota=True,user_id='71b5367c71554655ac7f27c79ed38859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Creating volume 52789dbb-05d6-49fe-8b0c-1de61b4274c5 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:04 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:18:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:04 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 1073741824 Jul 06 12:18:04 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9dc942fc-3e0d-4f6b-9d4c-1107d301e431 tempest-VolumesSnapshotTestJSON-1380866723 None] Create snapshot completed successfully Jul 06 12:18:06 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 1073741824" returned: 0 in 1.127s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:06 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 Jul 06 12:18:06 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (7010f47b-cab2-4f21-b81b-e7783b4c735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72189d3e-2cbd-4b9f-814b-da911e5b172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72189d3e-2cbd-4b9f-814b-da911e5b172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272988739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9c4af7-02f7-44d1-b274-f3ef4bdb19dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6909ae65-d9da-4bd9-9537-02af9da51044,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:07Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2ff622-d39d-418b-9f3f-950d42b753d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2ff622-d39d-418b-9f3f-950d42b753d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ace41-58c6-48e5-9ee4-dece63c2c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191ace41-58c6-48e5-9ee4-dece63c2c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df9c4af7-02f7-44d1-b274-f3ef4bdb19dd', 'volume_name': 'volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd', 'volume_size': 2, 'snapshot_id': '6909ae65-d9da-4bd9-9537-02af9da51044'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4e9696-90ee-4ca7-ac85-7c9730b6093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4e9696-90ee-4ca7-ac85-7c9730b6093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd430c3-7e10-4089-b6d9-ed90834e7ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:06 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume df9c4af7-02f7-44d1-b274-f3ef4bdb19dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd', 'volume_size': 2, 'snapshot_id': '6909ae65-d9da-4bd9-9537-02af9da51044'} Jul 06 12:18:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:07 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5" returned: 0 in 0.876s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.303s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-6909ae65-d9da-4bd9-9537-02af9da51044-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be88b74-72cb-40ad-a7c7-c42a94680f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0df65e-d8d3-4be5-8e64-68fc6b844d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-6909ae65-d9da-4bd9-9537-02af9da51044-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating volume df9c4af7-02f7-44d1-b274-f3ef4bdb19dd from snapshot 6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:07 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Volume volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 (52789dbb-05d6-49fe-8b0c-1de61b4274c5): created successfully Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0df65e-d8d3-4be5-8e64-68fc6b844d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Flow 'volume_create_manager' (6a2d02fa-29b7-41a2-bee7-e2752b9fc9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] snapshot: 6909ae65-d9da-4bd9-9537-02af9da51044, volume: df9c4af7-02f7-44d1-b274-f3ef4bdb19dd, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:18:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-85e26b64-6157-4db8-8a3c-3195d588e983 tempest-VolumesTransfersV355Test-1633219309 None] Created volume successfully. Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b82d7f4-e2d5-4596-abc0-430cb4c70972]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:07 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 Jul 06 12:18:07 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Acquiring lock "cinder-52789dbb-05d6-49fe-8b0c-1de61b4274c5-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-52789dbb-05d6-49fe-8b0c-1de61b4274c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:08 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044" returned: 0 in 0.939s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Acquiring lock "cinder-quobyte-52789dbb-05d6-49fe-8b0c-1de61b4274c5" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[002d4bd0-fd13-450a-9eb5-31306daac702]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-quobyte-52789dbb-05d6-49fe-8b0c-1de61b4274c5" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a748fc90-0fc8-4778-800e-b67e79bc5504]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:08 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c Jul 06 12:18:08 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:08 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 Jul 06 12:18:08 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:09 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5" returned: 0 in 1.094s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:09 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5 Jul 06 12:18:09 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:09 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" returned: 0 in 1.194s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:09 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:18:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:09 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd Jul 06 12:18:09 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:10 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52789dbb-05d6-49fe-8b0c-1de61b4274c5" returned: 0 in 0.967s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-quobyte-52789dbb-05d6-49fe-8b0c-1de61b4274c5" released by "delete_volume" :: held 2.122s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Created reservations ['2338cd89-3f8a-4c85-bcd0-0cf247e2949b', 'ad8f4028-01cc-40d3-9a00-b5144667c7ac', '4ae3fac2-f8ee-4a4d-84bc-256c3267ca0e', '89ad4dd8-fd6c-42e6-af83-d374f3021689'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:10 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:10 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:12 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.898s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Deleted volume successfully. Jul 06 12:18:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-916bee1d-3150-4c54-aa01-47fa80d8830b tempest-VolumesTransfersV355Test-746928778 None] Lock "cinder-52789dbb-05d6-49fe-8b0c-1de61b4274c5-delete_volume" released by "delete_volume" :: held 4.553s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:16 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" returned: 0 in 6.857s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c49ad54-24d6-4108-827a-33996b4b0ea4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:16 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c Jul 06 12:18:16 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:17 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" returned: 0 in 1.190s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:17 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:18:17 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Converted 1024.00 MB image at 149.30 MB/s Jul 06 12:18:17 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd is being set with open permissions: ugo+rw Jul 06 12:18:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:17 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd Jul 06 12:18:17 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:18 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" returned: 0 in 1.101s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" released by "_copy_volume_from_snapshot" :: held 11.430s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-6909ae65-d9da-4bd9-9537-02af9da51044-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" released by "_create_volume_from_snapshot" :: held 11.490s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.540s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd430c3-7e10-4089-b6d9-ed90834e7ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd', 'volume_size': 2, 'snapshot_id': '6909ae65-d9da-4bd9-9537-02af9da51044'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e672b9-9eff-4bff-a809-0a961a304d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:18 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd (df9c4af7-02f7-44d1-b274-f3ef4bdb19dd): created successfully Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e672b9-9eff-4bff-a809-0a961a304d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (7010f47b-cab2-4f21-b81b-e7783b4c735f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-542726fd-b94c-4d37-9a9c-9e721fa99a63 tempest-VolumesSnapshotTestJSON-1380866723 None] Created volume successfully. Jul 06 12:18:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:19 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe287f-0515-4cb4-bf88-4d760a771a7a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:19 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd Jul 06 12:18:19 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:20 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" returned: 0 in 0.975s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:20 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd Jul 06 12:18:20 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:21 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" returned: 0 in 1.068s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd" released by "delete_volume" :: held 2.132s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['8d4a1676-aa41-49c2-9d75-9462bf5f88d2', '37a8e63b-3484-492e-a8ba-561bcfd32ccd', '55688adf-a219-486c-965f-11bf659a363b', 'f8484ffa-39e9-457e-9a5f-f3a9a509df18'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:21 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:21 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Flow 'volume_create_manager' (36c9bce6-876d-475c-b2f7-cf4f0a648d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36764e6e-0ecc-4d9a-86b1-41c4da787030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36764e6e-0ecc-4d9a-86b1-41c4da787030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-392697678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f562beb-228f-46be-b781-f541c1bfba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2c992e68f4b96ac207e3f7ebfe848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:22Z,use_quota=True,user_id='828c25abb1a74651be55bcd5635ac306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d47915-e5fb-4a1a-92ac-b2ea75367dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d47915-e5fb-4a1a-92ac-b2ea75367dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f268393-9e7d-4d82-9c88-bb9d07c8e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f268393-9e7d-4d82-9c88-bb9d07c8e63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f562beb-228f-46be-b781-f541c1bfba31', 'volume_name': 'volume-5f562beb-228f-46be-b781-f541c1bfba31', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d433fd1-88eb-4913-8a6f-6d9e85a0c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d433fd1-88eb-4913-8a6f-6d9e85a0c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e540787-587f-4978-a88f-2aeda239ab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:22 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Volume 5f562beb-228f-46be-b781-f541c1bfba31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f562beb-228f-46be-b781-f541c1bfba31', 'volume_size': 1} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-392697678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f562beb-228f-46be-b781-f541c1bfba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2c992e68f4b96ac207e3f7ebfe848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:22Z,use_quota=True,user_id='828c25abb1a74651be55bcd5635ac306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Creating volume 5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:22 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:22 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.852s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Deleted volume successfully. Jul 06 12:18:22 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 1073741824 Jul 06 12:18:22 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-88cdbcf5-6a4c-42d2-8b38-4dec6a06b680 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-df9c4af7-02f7-44d1-b274-f3ef4bdb19dd-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-6909ae65-d9da-4bd9-9537-02af9da51044-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-6909ae65-d9da-4bd9-9537-02af9da51044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-6909ae65-d9da-4bd9-9537-02af9da51044" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-6909ae65-d9da-4bd9-9537-02af9da51044" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Deleting offline snapshot 6909ae65-d9da-4bd9-9537-02af9da51044 of volume 12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] snapshot_file for this snap is: volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b055095-7574-4d79-b64a-8a0848da7b63]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:23 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 Jul 06 12:18:23 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:23 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 1073741824" returned: 0 in 1.212s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:23 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 Jul 06 12:18:23 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:24 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044" returned: 0 in 0.954s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e0137b-f759-4727-98e1-55c1396cfc23]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:24 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c Jul 06 12:18:24 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:24 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31" returned: 0 in 0.734s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e540787-587f-4978-a88f-2aeda239ab52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f562beb-228f-46be-b781-f541c1bfba31', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636e53ed-969f-4f49-849d-9cc27785dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:24 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Volume volume-5f562beb-228f-46be-b781-f541c1bfba31 (5f562beb-228f-46be-b781-f541c1bfba31): created successfully Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636e53ed-969f-4f49-849d-9cc27785dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Flow 'volume_create_manager' (36c9bce6-876d-475c-b2f7-cf4f0a648d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:24 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e048e906-de75-4453-86b2-4d130e40bfd1 tempest-VolumesCloneTest-100959159 None] Created volume successfully. Jul 06 12:18:25 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" returned: 0 in 0.896s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:25 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 Jul 06 12:18:25 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:25 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044" returned: 0 in 0.823s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:25 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044 Jul 06 12:18:25 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Flow 'volume_create_manager' (4d83fce3-36c9-408a-9e1c-fac4a1715e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac422f-4a02-4f72-9390-9d53a2ee326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac422f-4a02-4f72-9390-9d53a2ee326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1796609802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea92b1c-fd7d-4688-a015-85bbe2f6269d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a2c992e68f4b96ac207e3f7ebfe848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5f562beb-228f-46be-b781-f541c1bfba31,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:26Z,use_quota=True,user_id='828c25abb1a74651be55bcd5635ac306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b889cf13-c523-42a9-998e-95baa8362428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b889cf13-c523-42a9-998e-95baa8362428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83ecb36-9c43-4872-be6e-54fddf4cf053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83ecb36-9c43-4872-be6e-54fddf4cf053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3ea92b1c-fd7d-4688-a015-85bbe2f6269d', 'volume_name': 'volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d', 'volume_size': 2, 'source_volid': '5f562beb-228f-46be-b781-f541c1bfba31', 'source_volstatus': 'available'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b568265-aafd-4334-8585-b87011284c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b568265-aafd-4334-8585-b87011284c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b36608e-d128-40fb-808b-80e286423592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Volume 3ea92b1c-fd7d-4688-a015-85bbe2f6269d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d', 'volume_size': 2, 'source_volid': '5f562beb-228f-46be-b781-f541c1bfba31', 'source_volstatus': 'available'} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:26 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Cloning volume 5f562beb-228f-46be-b781-f541c1bfba31 to volume 3ea92b1c-fd7d-4688-a015-85bbe2f6269d Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Creating offline snapshot c6448831-41d0-40fd-b80c-a02f4a0b2cad of volume 5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2432dbf4-4c5b-4c7a-8452-781c880c9b18]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:26 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c.6909ae65-d9da-4bd9-9537-02af9da51044" returned: 0 in 0.805s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:26 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 Jul 06 12:18:26 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-6909ae65-d9da-4bd9-9537-02af9da51044" released by "_delete_snapshot" :: held 3.658s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" released by "delete_snapshot" :: held 3.699s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['831db477-902f-4b66-9e54-2163cb41cb10', '9fc63978-bf88-4b38-af7e-87cf24b09434', 'a46adbd1-d25b-4551-aa94-d056c47ae27c', 'a06a9924-b783-4410-967d-d9fcb9cd5e80'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:26 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Delete snapshot completed successfully. Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-728a0823-b66c-409f-a5e7-ea6e933c5379 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-6909ae65-d9da-4bd9-9537-02af9da51044-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:27 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:27 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:27 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31" returned: 0 in 0.972s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:27 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad 1G Jul 06 12:18:27 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[02789263-2835-4a36-8c42-de9a596ad27d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:27 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c Jul 06 12:18:27 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:27 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.938s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:18:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:18:28 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad 1G" returned: 0 in 1.076s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f562beb-228f-46be-b781-f541c1bfba31 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:28 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f562beb-228f-46be-b781-f541c1bfba31 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad Jul 06 12:18:28 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:28 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" returned: 0 in 1.004s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:28 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c Jul 06 12:18:28 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:29 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" returned: 0 in 0.772s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c" released by "delete_volume" :: held 1.862s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:29 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f562beb-228f-46be-b781-f541c1bfba31 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad" returned: 0 in 0.892s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:29 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad is being set with open permissions: ugo+rw Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:29 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad Jul 06 12:18:29 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['b42a39d6-a52b-4141-bc57-f6c62ab9bf1f', '46a5a609-1b58-4edd-b8f9-0c8f0623a707', '4c76e83a-936a-4871-b9f1-67c4b7315e22', '39cd7ec9-a4e2-4cb5-bf73-d1b112cc92cc'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:29 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:29 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:30 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad" returned: 0 in 0.935s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:30 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.884s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:30 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.info Jul 06 12:18:30 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Deleted volume successfully. Jul 06 12:18:30 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (b1f4dfc3-07ce-47af-ad79-32a9ccfc6f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dae79c-e5e9-4148-8f34-dd5b85521016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-aa43be46-3056-40d4-9eb8-32e660ceded2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-12a72ea2-4abc-468a-8d4d-9fdc5bac7d5c-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dae79c-e5e9-4148-8f34-dd5b85521016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-134428384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffca603a-2f6a-4b9c-a867-490e98d90773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:30Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cfe5b9-de77-400f-9cdb-d34eca3cf68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cfe5b9-de77-400f-9cdb-d34eca3cf68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0063a2ca-e85f-4318-94d9-ba01282a516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0063a2ca-e85f-4318-94d9-ba01282a516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffca603a-2f6a-4b9c-a867-490e98d90773', 'volume_name': 'volume-ffca603a-2f6a-4b9c-a867-490e98d90773', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4e5394-b0f8-4705-9847-16bed62fd309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4e5394-b0f8-4705-9847-16bed62fd309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c29fe8-c589-4453-8471-bde758e01755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume ffca603a-2f6a-4b9c-a867-490e98d90773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffca603a-2f6a-4b9c-a867-490e98d90773', 'volume_size': 1} Jul 06 12:18:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:31 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.info" returned: 0 in 0.710s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:31 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.info is being set with open permissions: ugo+rw Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:31 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.info Jul 06 12:18:31 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:31 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.info" returned: 0 in 0.697s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Acquiring lock "cinder-quobyte-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] snapshot: c6448831-41d0-40fd-b80c-a02f4a0b2cad, volume: 3ea92b1c-fd7d-4688-a015-85bbe2f6269d, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c099de7-a041-47b4-8f73-67fce62e445b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:32 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad Jul 06 12:18:32 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:32 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad" returned: 0 in 0.833s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f562beb-228f-46be-b781-f541c1bfba31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:18:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:18:32 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[16591ef8-31f3-4ef9-b7c1-9b0c63a1fb5f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:32 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 Jul 06 12:18:32 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:33 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31" returned: 0 in 0.898s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:33 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:18:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:33 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d Jul 06 12:18:33 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:38 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" returned: 0 in 4.914s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66816d-75dc-4a34-b6b8-6b5c89b32e25]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:38 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 Jul 06 12:18:38 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:39 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31" returned: 0 in 0.987s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:39 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:18:39 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Converted 1024.00 MB image at 208.35 MB/s Jul 06 12:18:39 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d is being set with open permissions: ugo+rw Jul 06 12:18:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:39 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d Jul 06 12:18:39 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:40 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" returned: 0 in 0.799s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" released by "_copy_volume_from_snapshot" :: held 8.514s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=95,cinder:INSERT=25,cinder:UPDATE=102,cinder:DELETE=10 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Acquiring lock "cinder-quobyte-c6448831-41d0-40fd-b80c-a02f4a0b2cad" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-c6448831-41d0-40fd-b80c-a02f4a0b2cad" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Deleting offline snapshot c6448831-41d0-40fd-b80c-a02f4a0b2cad of volume 5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] snapshot_file for this snap is: volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48ac569-82f0-4d1a-a87d-02e34700ca4e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:40 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:INSERT=31,cinder:UPDATE=117,cinder:SELECT=91,cinder:DELETE=8 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:18:40 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad Jul 06 12:18:40 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:41 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad" returned: 0 in 0.823s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f562beb-228f-46be-b781-f541c1bfba31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:41 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ce41bc-cc17-4655-8107-94fdf63c8c52]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:41 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 Jul 06 12:18:41 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:42 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31" returned: 0 in 0.836s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:42 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad Jul 06 12:18:42 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:43 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad" returned: 0 in 0.950s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:43 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad Jul 06 12:18:43 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:44 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31.c6448831-41d0-40fd-b80c-a02f4a0b2cad" returned: 0 in 0.908s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-c6448831-41d0-40fd-b80c-a02f4a0b2cad" released by "_delete_snapshot" :: held 3.642s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.722s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.553s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-134428384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffca603a-2f6a-4b9c-a867-490e98d90773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:30Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating volume ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:44 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:44 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 1073741824 Jul 06 12:18:44 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b36608e-d128-40fb-808b-80e286423592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d', 'volume_size': 2, 'source_volid': '5f562beb-228f-46be-b781-f541c1bfba31', 'source_volstatus': 'available'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e392307-73f1-41c4-aa53-dc70c2480755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:44 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Volume volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d (3ea92b1c-fd7d-4688-a015-85bbe2f6269d): created successfully Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e392307-73f1-41c4-aa53-dc70c2480755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Flow 'volume_create_manager' (4d83fce3-36c9-408a-9e1c-fac4a1715e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c2ab8c93-bc65-40f7-9188-d5c0d9d6f88c tempest-VolumesCloneTest-100959159 None] Created volume successfully. Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Acquiring lock "cinder-3ea92b1c-fd7d-4688-a015-85bbe2f6269d-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Lock "cinder-3ea92b1c-fd7d-4688-a015-85bbe2f6269d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Acquiring lock "cinder-quobyte-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1306f5d1-63a0-4f21-bc71-1c94ea736b00]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:45 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d Jul 06 12:18:45 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:45 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 1073741824" returned: 0 in 1.671s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:45 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 Jul 06 12:18:45 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:46 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" returned: 0 in 1.531s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:47 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d Jul 06 12:18:47 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:47 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773" returned: 0 in 1.163s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] <== create_volume: return (2904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.909s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c29fe8-c589-4453-8471-bde758e01755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffca603a-2f6a-4b9c-a867-490e98d90773', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ee8f25-09aa-4131-bd26-5ea53ef7c56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:47 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume volume-ffca603a-2f6a-4b9c-a867-490e98d90773 (ffca603a-2f6a-4b9c-a867-490e98d90773): created successfully Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ee8f25-09aa-4131-bd26-5ea53ef7c56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (b1f4dfc3-07ce-47af-ad79-32a9ccfc6f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:47 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c22f55bc-d077-4302-bdc3-08938b68d166 tempest-VolumesSnapshotTestJSON-1380866723 None] Created volume successfully. Jul 06 12:18:47 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" returned: 0 in 0.937s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-3ea92b1c-fd7d-4688-a015-85bbe2f6269d" released by "delete_volume" :: held 2.535s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Created reservations ['8924cd51-29fd-4920-9b0c-a83ad4f99317', '85685586-12f8-4b57-b4b8-58632a191a2b', 'fb8d68e8-bc6d-4a59-a867-f4a546fd85ec', '4ec16b25-1dab-4ebc-abad-8475a1e8d0ae'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating offline snapshot 67676ca3-b14e-4bf1-bb95-e20dea06daf7 of volume ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e986d8a8-de98-4970-a0d2-d8d560be725e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:48 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:48 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:48 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 Jul 06 12:18:48 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Acquiring lock "cinder-5f562beb-228f-46be-b781-f541c1bfba31-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Lock "cinder-5f562beb-228f-46be-b781-f541c1bfba31-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Acquiring lock "cinder-quobyte-5f562beb-228f-46be-b781-f541c1bfba31" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-5f562beb-228f-46be-b781-f541c1bfba31" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80949b7-6c5b-4b13-8d67-f8d441139b2d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:49 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.978s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Deleted volume successfully. Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-66a1ca4c-a764-4582-bb38-bdfbdad93dd2 tempest-VolumesCloneTest-100959159 None] Lock "cinder-3ea92b1c-fd7d-4688-a015-85bbe2f6269d-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:49 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773" returned: 0 in 1.031s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:49 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 Jul 06 12:18:49 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:49 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 1G Jul 06 12:18:49 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:50 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31" returned: 0 in 0.953s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:50 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31 Jul 06 12:18:50 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:50 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 1G" returned: 0 in 0.924s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffca603a-2f6a-4b9c-a867-490e98d90773 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:50 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffca603a-2f6a-4b9c-a867-490e98d90773 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 Jul 06 12:18:50 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:50 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5f562beb-228f-46be-b781-f541c1bfba31" returned: 0 in 0.785s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Lock "cinder-quobyte-5f562beb-228f-46be-b781-f541c1bfba31" released by "delete_volume" :: held 1.814s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Created reservations ['9e46ba2a-118e-4558-83de-d1a9083f13ed', '02dba96c-20df-4b5c-b416-39d7dcf7a50b', '9de8ab47-8749-40ba-89d7-26b1d4ef24b8', '91ef46c2-9123-4a91-a698-311f2e37ca79'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:50 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffca603a-2f6a-4b9c-a867-490e98d90773 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7" returned: 0 in 0.874s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:51 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 is being set with open permissions: ugo+rw Jul 06 12:18:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:51 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:51 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:51 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 Jul 06 12:18:51 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:51 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7" returned: 0 in 0.852s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:51 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.info Jul 06 12:18:51 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:51 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.009s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:51 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:52 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Deleted volume successfully. Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99514431-35a4-470e-9aef-255bdaf64d45 tempest-VolumesCloneTest-100959159 None] Lock "cinder-5f562beb-228f-46be-b781-f541c1bfba31-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Acquiring lock "cinder-8523f481-7964-42f6-9ae7-03a97c746429-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "cinder-8523f481-7964-42f6-9ae7-03a97c746429-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Acquiring lock "cinder-quobyte-8523f481-7964-42f6-9ae7-03a97c746429" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "cinder-quobyte-8523f481-7964-42f6-9ae7-03a97c746429" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa18d845-701e-4b47-88a2-ddb256ad5975]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:52 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.info" returned: 0 in 0.907s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:52 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.info is being set with open permissions: ugo+rw Jul 06 12:18:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:52 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 Jul 06 12:18:52 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:52 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.info Jul 06 12:18:52 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:53 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429" returned: 0 in 0.895s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:53 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429 Jul 06 12:18:53 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:53 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.info" returned: 0 in 0.839s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.592s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c9dc8150-da1a-4946-b3c7-3fe364dbf482 tempest-VolumesSnapshotTestJSON-1380866723 None] Create snapshot completed successfully Jul 06 12:18:54 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8523f481-7964-42f6-9ae7-03a97c746429" returned: 0 in 0.837s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "cinder-quobyte-8523f481-7964-42f6-9ae7-03a97c746429" released by "delete_volume" :: held 1.780s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Created reservations ['ad1328e8-b85c-4f5f-86ef-551dc3dc9bb4', 'f51c4712-4b35-4ab8-8685-cdef943d59d1', 'c9feabfc-21b3-401b-9941-d953b554b91d', '343b7ff6-9b7d-4d02-aa43-6a94998c8c14'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:54 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:18:54 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (c00ab2f0-4858-4ab0-97b6-62d83e62d02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54af8690-77be-4fa4-9013-6720190f9392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54af8690-77be-4fa4-9013-6720190f9392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-49849805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641d62d0-08c9-49d4-a75f-255c7af5e5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87829b53304e4f06a0892889b54efbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67676ca3-b14e-4bf1-bb95-e20dea06daf7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:55Z,use_quota=True,user_id='b85783cac6fa4bb0b2584e3b8073069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5212fca7-a10c-463c-9e16-95821f796bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5212fca7-a10c-463c-9e16-95821f796bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a6ceee-2883-49b7-bbc6-14bad5ec5963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a6ceee-2883-49b7-bbc6-14bad5ec5963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '641d62d0-08c9-49d4-a75f-255c7af5e5a4', 'volume_name': 'volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4', 'volume_size': 1, 'snapshot_id': '67676ca3-b14e-4bf1-bb95-e20dea06daf7'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91170bc-2586-4d85-8762-ffd4db3f22d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91170bc-2586-4d85-8762-ffd4db3f22d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3c5227-32c4-40f8-835e-39ed14e4f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume 641d62d0-08c9-49d4-a75f-255c7af5e5a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4', 'volume_size': 1, 'snapshot_id': '67676ca3-b14e-4bf1-bb95-e20dea06daf7'} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-67676ca3-b14e-4bf1-bb95-e20dea06daf7-641d62d0-08c9-49d4-a75f-255c7af5e5a4" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-67676ca3-b14e-4bf1-bb95-e20dea06daf7-641d62d0-08c9-49d4-a75f-255c7af5e5a4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating volume 641d62d0-08c9-49d4-a75f-255c7af5e5a4 from snapshot 67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-641d62d0-08c9-49d4-a75f-255c7af5e5a4" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-641d62d0-08c9-49d4-a75f-255c7af5e5a4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] snapshot: 67676ca3-b14e-4bf1-bb95-e20dea06daf7, volume: 641d62d0-08c9-49d4-a75f-255c7af5e5a4, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60da1f6-7458-479c-8ec0-164c92b8578e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:55 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.878s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Flow 'volume_create_manager' (01bba2d0-7fff-4656-a5a2-2439298c3fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4f3ce2-acc0-439f-a902-da9245a3a6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Deleted volume successfully. Jul 06 12:18:55 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 Jul 06 12:18:55 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4f3ce2-acc0-439f-a902-da9245a3a6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1126798385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced54268-c105-4bbb-8408-5861e2c5e33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330ee9a80c4d43b5983d05defdd79c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:55Z,use_quota=True,user_id='7f8018aa49c1455880145e366d121b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3aba98-4825-4fe2-b979-3657497f1f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3aba98-4825-4fe2-b979-3657497f1f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ec7ebc-f1e2-4317-90e9-9dd0b1ca6a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0dadcb9e-83f4-447b-a9a6-42bdb7a23e8c tempest-AttachVolumeShelveTestJSON-1094234177 None] Lock "cinder-8523f481-7964-42f6-9ae7-03a97c746429-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ec7ebc-f1e2-4317-90e9-9dd0b1ca6a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ced54268-c105-4bbb-8408-5861e2c5e33f', 'volume_name': 'volume-ced54268-c105-4bbb-8408-5861e2c5e33f', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5146bf4-670a-47c2-8fb4-8eef93373e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5146bf4-670a-47c2-8fb4-8eef93373e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceeca1d0-4475-43d4-aa91-40722cbf1811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Volume ced54268-c105-4bbb-8408-5861e2c5e33f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ced54268-c105-4bbb-8408-5861e2c5e33f', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:18:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Trying to clone ced54268-c105-4bbb-8408-5861e2c5e33f from image b501de2b-75f2-48fc-a750-711c22cfabf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:18:56 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:18:56 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7" returned: 0 in 0.962s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffca603a-2f6a-4b9c-a867-490e98d90773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[10001934-1b2a-4979-8404-0eca6f4e863c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c94ea9-1f87-4e23-8f64-751b820c6aea]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:56 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 Jul 06 12:18:56 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:56 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD Jul 06 12:18:56 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:57 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:57 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 is fetched for user 7f8018aa49c1455880145e366d121b8b. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:18:57 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773" returned: 0 in 0.935s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:57 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:18:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:57 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 Jul 06 12:18:57 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bc9970-3b4a-49ff-aa1f-bf0a9dd20bec]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:57 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD Jul 06 12:18:57 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:58 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD" returned: 0 in 0.927s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:03 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4" returned: 0 in 5.956s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad9ba2-4dbd-4220-91df-a57b241ad66d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:03 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 Jul 06 12:19:03 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:04 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773" returned: 0 in 1.066s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:04 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:19:04 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Converted 1024.00 MB image at 171.89 MB/s Jul 06 12:19:04 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 is being set with open permissions: ugo+rw Jul 06 12:19:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:04 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 Jul 06 12:19:04 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:05 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4" returned: 0 in 0.781s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-641d62d0-08c9-49d4-a75f-255c7af5e5a4" released by "_copy_volume_from_snapshot" :: held 9.816s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-67676ca3-b14e-4bf1-bb95-e20dea06daf7-641d62d0-08c9-49d4-a75f-255c7af5e5a4" released by "_create_volume_from_snapshot" :: held 9.848s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.869s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.805s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1126798385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced54268-c105-4bbb-8408-5861e2c5e33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330ee9a80c4d43b5983d05defdd79c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:55Z,use_quota=True,user_id='7f8018aa49c1455880145e366d121b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Creating volume ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:05 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:05 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 1073741824 Jul 06 12:19:05 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3c5227-32c4-40f8-835e-39ed14e4f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4', 'volume_size': 1, 'snapshot_id': '67676ca3-b14e-4bf1-bb95-e20dea06daf7'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f02df4c-4d45-4235-ac08-34824fa0ecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:05 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Volume volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 (641d62d0-08c9-49d4-a75f-255c7af5e5a4): created successfully Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f02df4c-4d45-4235-ac08-34824fa0ecd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Flow 'volume_create_manager' (c00ab2f0-4858-4ab0-97b6-62d83e62d02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-09e4f160-9501-43d3-8d26-f746eac37ae6 tempest-VolumesSnapshotTestJSON-1380866723 None] Created volume successfully. Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-641d62d0-08c9-49d4-a75f-255c7af5e5a4-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-641d62d0-08c9-49d4-a75f-255c7af5e5a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-641d62d0-08c9-49d4-a75f-255c7af5e5a4" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-641d62d0-08c9-49d4-a75f-255c7af5e5a4" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3388bf-e900-4a0d-94f1-cc88c6fbd732]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:06 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 1073741824" returned: 0 in 1.194s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:06 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:06 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:06 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 Jul 06 12:19:06 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:07 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 0 in 0.889s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:07 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Attempting download of b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume ced54268-c105-4bbb-8408-5861e2c5e33f. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4" returned: 0 in 1.074s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:07 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4 Jul 06 12:19:07 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7901b3-5ec4-4338-b758-39df21df8439]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_b576gph6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:07 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_b576gph6 Jul 06 12:19:07 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:08 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-641d62d0-08c9-49d4-a75f-255c7af5e5a4" returned: 0 in 0.858s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-641d62d0-08c9-49d4-a75f-255c7af5e5a4" released by "delete_volume" :: held 1.998s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:08 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_b576gph6" returned: 0 in 0.839s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_b576gph6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['3053e6f8-8834-42d0-afbd-87573745d25d', 'b5dec03d-c18d-4366-a2d2-0dd09982d024', 'f4f09fd3-b572-4f37-b434-5d0dedbbe15a', '6d12a5ea-d5d7-4b9f-a3b8-8b27954aeab9'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:08 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_b576gph6 Jul 06 12:19:08 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:08 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:19:08 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-67676ca3-b14e-4bf1-bb95-e20dea06daf7-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-67676ca3-b14e-4bf1-bb95-e20dea06daf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-ffca603a-2f6a-4b9c-a867-490e98d90773" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-ffca603a-2f6a-4b9c-a867-490e98d90773" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-67676ca3-b14e-4bf1-bb95-e20dea06daf7" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-67676ca3-b14e-4bf1-bb95-e20dea06daf7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Deleting offline snapshot 67676ca3-b14e-4bf1-bb95-e20dea06daf7 of volume ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] snapshot_file for this snap is: volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e315248d-49b9-41d5-8c6c-1314dcabdb10]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:09 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 Jul 06 12:19:09 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:09 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_b576gph6" returned: 1 in 1.035s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b501de2b-75f2-48fc-a750-711c22cfabf3_b576gph6' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[85928500-4b19-4016-81b3-5b4573533e8b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:09 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Deleted volume successfully. Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a438b86b-9223-4338-8820-e29244acdc7f tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-641d62d0-08c9-49d4-a75f-255c7af5e5a4-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:09 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD Jul 06 12:19:09 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:09 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7" returned: 0 in 1.117s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffca603a-2f6a-4b9c-a867-490e98d90773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b0c54-34a4-43de-8022-84b82256a34b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:10 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 Jul 06 12:19:10 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:10 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD" returned: 0 in 0.909s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:10 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] b501de2b-75f2-48fc-a750-711c22cfabf3 was qcow2, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:19:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:10 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:10 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:11 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773" returned: 0 in 1.010s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:11 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 Jul 06 12:19:11 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:12 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7" returned: 0 in 1.079s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:12 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7 Jul 06 12:19:12 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:12 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773.67676ca3-b14e-4bf1-bb95-e20dea06daf7" returned: 0 in 0.888s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-67676ca3-b14e-4bf1-bb95-e20dea06daf7" released by "_delete_snapshot" :: held 4.270s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-ffca603a-2f6a-4b9c-a867-490e98d90773" released by "delete_snapshot" :: held 4.306s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['280a8adf-e115-4652-b315-3eec57264af6', 'a77fb452-79a0-485f-ae43-01130a25bd55', 'c5453bae-23a9-4567-b0cf-ca84c9f6c269', '93a73f54-c2d0-437a-8bb5-18301518463f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Delete snapshot completed successfully. Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cc319fe6-393a-49da-9363-9352aaa8841c tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-67676ca3-b14e-4bf1-bb95-e20dea06daf7-delete_snapshot" released by "delete_snapshot" :: held 4.541s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:13 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 0 in 3.092s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b501de2b-75f2-48fc-a750-711c22cfabf3_ln47z2ledevstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:19:13 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Converted 112.00 MB image at 36.21 MB/s Jul 06 12:19:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:13 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 1G Jul 06 12:19:13 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-ffca603a-2f6a-4b9c-a867-490e98d90773-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:14 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-ffca603a-2f6a-4b9c-a867-490e98d90773-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 1G" returned: 0 in 0.964s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-ffca603a-2f6a-4b9c-a867-490e98d90773" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845dfb7-b002-42ea-88d3-2097aeb96356]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-ffca603a-2f6a-4b9c-a867-490e98d90773" acquired by "delete_volume" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b517fc01-1c05-447f-9920-d9a4c2d5a7ff]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:14 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:14 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:14 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 Jul 06 12:19:14 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:15 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773" returned: 0 in 1.111s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:15 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773 Jul 06 12:19:15 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:15 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 0 in 1.345s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:15 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:15 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:16 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ffca603a-2f6a-4b9c-a867-490e98d90773" returned: 0 in 0.748s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-ffca603a-2f6a-4b9c-a867-490e98d90773" released by "delete_volume" :: held 1.970s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['b5b00aab-d888-43f9-a7cf-e97fd629a33e', 'c58958cb-3c99-4079-9f37-d15a8a3c52b4', '7e00772b-ba58-47cf-b769-9d66c03f6348', 'd4f14975-4f07-4c12-bf01-6d949a98a876'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:16 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:19:16 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:16 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 1 in 0.982s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Downloaded image b501de2b-75f2-48fc-a750-711c22cfabf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}])) to volume ced54268-c105-4bbb-8408-5861e2c5e33f successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Temporary image b501de2b-75f2-48fc-a750-711c22cfabf3 for user 7f8018aa49c1455880145e366d121b8b is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Marking volume ced54268-c105-4bbb-8408-5861e2c5e33f as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Copying metadata from image b501de2b-75f2-48fc-a750-711c22cfabf3 to ced54268-c105-4bbb-8408-5861e2c5e33f. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Creating volume glance metadata for volume ced54268-c105-4bbb-8408-5861e2c5e33f backed by image b501de2b-75f2-48fc-a750-711c22cfabf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:19:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-52b492ab-15a2-4d9b-9210-dd37647e759b-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-52b492ab-15a2-4d9b-9210-dd37647e759b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "cinder-quobyte-52b492ab-15a2-4d9b-9210-dd37647e759b" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-52b492ab-15a2-4d9b-9210-dd37647e759b" acquired by "delete_volume" :: waited 0.041s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4890396c-c06a-469c-bb76-8110fd5787a8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceeca1d0-4475-43d4-aa91-40722cbf1811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced54268-c105-4bbb-8408-5861e2c5e33f', 'volume_size': 1, 'image_id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b501de2b-75f2-48fc-a750-711c22cfabf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b64734d49454b9c902e9ac6cac9544f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b501de2b-75f2-48fc-a750-711c22cfabf3', 'created_at': datetime.datetime(2026, 7, 6, 10, 0, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 0, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b501de2b-75f2-48fc-a750-711c22cfabf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36968ff5-ffec-4723-a477-765ef4433d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:17 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Volume volume-ced54268-c105-4bbb-8408-5861e2c5e33f (ced54268-c105-4bbb-8408-5861e2c5e33f): created successfully Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36968ff5-ffec-4723-a477-765ef4433d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Flow 'volume_create_manager' (01bba2d0-7fff-4656-a5a2-2439298c3fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-784568bb-f4ac-4c0d-87df-1df205df5b36 tempest-VolumesExtendTest-1408249724 None] Created volume successfully. Jul 06 12:19:17 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b Jul 06 12:19:17 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:17 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.823s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Deleted volume successfully. Jul 06 12:19:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57dcf66e-0a18-4cf1-81f3-7a3fc01c49f9 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-ffca603a-2f6a-4b9c-a867-490e98d90773-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:18 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b" returned: 0 in 0.944s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:18 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b Jul 06 12:19:18 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:18 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-52b492ab-15a2-4d9b-9210-dd37647e759b" returned: 0 in 0.662s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-quobyte-52b492ab-15a2-4d9b-9210-dd37647e759b" released by "delete_volume" :: held 1.682s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Created reservations ['e19cd92a-29ca-46d0-8fb5-abede2f32471', '60db5ef7-81f7-4621-9d29-54bf7a97c144', 'b01c11df-d237-4d16-bc4b-7cda04e307a7', 'a0530bb9-2c78-4b2d-bd38-261d7b72bab8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a19839-1cda-4f4c-bc77-94f3b6399c3e]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:22 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:22 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:22 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:19:22 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:23 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 0 in 1.033s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:23 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.909s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:23 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Deleted volume successfully. Jul 06 12:19:23 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:23 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ce3d3766-f91b-4ef7-89ec-a55de99fb5f2 tempest-VolumesSnapshotTestJSON-1380866723 None] Lock "cinder-52b492ab-15a2-4d9b-9210-dd37647e759b-delete_volume" released by "delete_volume" :: held 6.856s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:24 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 1 in 0.952s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:19:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 2G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f 2G" returned: 0 in 0.070s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.107s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:24 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ec49b4df-468f-4256-ab09-be569b2f1410 tempest-VolumesExtendTest-1408249724 None] Extend volume completed successfully. Jul 06 12:19:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "cinder-ced54268-c105-4bbb-8408-5861e2c5e33f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-ced54268-c105-4bbb-8408-5861e2c5e33f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "cinder-quobyte-ced54268-c105-4bbb-8408-5861e2c5e33f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-ced54268-c105-4bbb-8408-5861e2c5e33f" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:26 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad415b2-ee7b-433d-9098-dfe5abbc5d0c]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:26 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:26 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:27 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:19:27 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:27 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 0 in 1.125s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:27 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:27 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:27 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.803s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:19:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:19:28 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 1 in 0.950s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:19:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:28 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f Jul 06 12:19:28 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:29 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-ced54268-c105-4bbb-8408-5861e2c5e33f" returned: 0 in 0.710s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-ced54268-c105-4bbb-8408-5861e2c5e33f" released by "delete_volume" :: held 2.886s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Created reservations ['ae898ce7-9349-49e4-8028-a8844428038b', '45db691e-7039-479b-8861-1e87f04b4086', '9fcb6428-1c9a-40c1-9fdd-3933e87344b6', '8ccf9465-a0a0-409e-bf83-529bf20abe91'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:29 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:19:29 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:30 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.762s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:30 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Deleted volume successfully. Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-58dfc405-5748-4a95-845d-1dec699796f8 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-ced54268-c105-4bbb-8408-5861e2c5e33f-delete_volume" released by "delete_volume" :: held 3.903s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Flow 'volume_create_manager' (5184fcec-9b82-4d1a-a607-658ae9bb4682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a865d44-9c34-49d2-9dab-2dbbbeb6d21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a865d44-9c34-49d2-9dab-2dbbbeb6d21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1499527488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b9abeb-9add-46e0-8a33-3da7efe431b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330ee9a80c4d43b5983d05defdd79c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:30Z,use_quota=True,user_id='7f8018aa49c1455880145e366d121b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1880ba41-e2a1-424e-852b-1b55af0ebf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1880ba41-e2a1-424e-852b-1b55af0ebf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce754f30-490e-482c-a4f4-dcec094a4868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce754f30-490e-482c-a4f4-dcec094a4868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b9abeb-9add-46e0-8a33-3da7efe431b6', 'volume_name': 'volume-40b9abeb-9add-46e0-8a33-3da7efe431b6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc401db-d38f-4495-be1b-6e204ad33fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc401db-d38f-4495-be1b-6e204ad33fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedf2c68-8536-4031-ac08-c1281f91fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Volume 40b9abeb-9add-46e0-8a33-3da7efe431b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b9abeb-9add-46e0-8a33-3da7efe431b6', 'volume_size': 1} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1499527488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b9abeb-9add-46e0-8a33-3da7efe431b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330ee9a80c4d43b5983d05defdd79c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:30Z,use_quota=True,user_id='7f8018aa49c1455880145e366d121b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Creating volume 40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:30 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:19:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:30 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 1073741824 Jul 06 12:19:30 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Flow 'volume_create_manager' (a4f1f273-41aa-4941-bdbc-ea13da705798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319029b7-9442-4724-a741-10625633d11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319029b7-9442-4724-a741-10625633d11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1091969336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df4d59c-a714-49eb-ae5b-ecbb627dd70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdf824bccd0420cbb3d0e203c8cfc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:31Z,use_quota=True,user_id='2d80af63444c46b487c81fd654c6c1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb900d-78d2-49fc-836a-a6e16525129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb900d-78d2-49fc-836a-a6e16525129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010f0e41-d7a9-478b-8880-8cb70007f127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010f0e41-d7a9-478b-8880-8cb70007f127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df4d59c-a714-49eb-ae5b-ecbb627dd70f', 'volume_name': 'volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf69963-da41-49fd-850a-5741ae9df30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf69963-da41-49fd-850a-5741ae9df30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029788be-8fac-49b5-b51b-2acc5a1fe6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f', 'volume_size': 1} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:31 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 1073741824" returned: 0 in 1.060s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:31 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 Jul 06 12:19:31 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:32 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6" returned: 0 in 0.765s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1091969336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df4d59c-a714-49eb-ae5b-ecbb627dd70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdf824bccd0420cbb3d0e203c8cfc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:31Z,use_quota=True,user_id='2d80af63444c46b487c81fd654c6c1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Creating volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:32 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedf2c68-8536-4031-ac08-c1281f91fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b9abeb-9add-46e0-8a33-3da7efe431b6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:32 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f 1073741824 Jul 06 12:19:32 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87c6fd9-8a8d-4d12-8215-2047e36c9316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Volume volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 (40b9abeb-9add-46e0-8a33-3da7efe431b6): created successfully Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87c6fd9-8a8d-4d12-8215-2047e36c9316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Flow 'volume_create_manager' (5184fcec-9b82-4d1a-a607-658ae9bb4682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:32 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2b716c48-2f40-4c21-81ba-a9db0de00b46 tempest-VolumesExtendTest-1408249724 None] Created volume successfully. Jul 06 12:19:33 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f 1073741824" returned: 0 in 1.075s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:33 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f Jul 06 12:19:33 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:34 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" returned: 0 in 0.789s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.536s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029788be-8fac-49b5-b51b-2acc5a1fe6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdfdad-7e34-49ab-9187-f99166806f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Creating offline snapshot 689527de-7fd5-4767-a4d9-4f00ddd1f5e4 of volume 40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:19:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Volume volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f (1df4d59c-a714-49eb-ae5b-ecbb627dd70f): created successfully Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdfdad-7e34-49ab-9187-f99166806f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Flow 'volume_create_manager' (a4f1f273-41aa-4941-bdbc-ea13da705798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aebf383-e9d9-435b-8ba9-cacbfa467682]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e9889531-3a7b-4e35-bc2a-7de87aa947e6 tempest-VolumesSnapshotListTestJSON-210848089 None] Created volume successfully. Jul 06 12:19:34 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 Jul 06 12:19:34 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:35 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6" returned: 0 in 0.857s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:35 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 1G Jul 06 12:19:35 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:35 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 1G" returned: 0 in 0.926s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:35 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 Jul 06 12:19:35 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:36 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4" returned: 0 in 1.032s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:36 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 is being set with open permissions: ugo+rw Jul 06 12:19:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:37 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 Jul 06 12:19:37 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:37 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4" returned: 0 in 0.774s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:37 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.info Jul 06 12:19:37 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:38 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.info" returned: 0 in 0.694s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:38 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.info is being set with open permissions: ugo+rw Jul 06 12:19:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:38 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.info Jul 06 12:19:38 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:39 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.info" returned: 0 in 0.733s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.156s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.591s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Creating offline snapshot 9b8c1fcc-1541-45e4-93f7-984aff51b00f of volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:19:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0691f39c-ea55-4c91-b267-d2f8fa4a27c4 tempest-VolumesExtendTest-1408249724 None] Create snapshot completed successfully Jul 06 12:19:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d4101-cdbf-479c-93cf-63ccb7ca07de]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:39 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f Jul 06 12:19:39 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:40 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" returned: 0 in 1.014s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:40 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f 1G Jul 06 12:19:40 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:41 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f 1G" returned: 0 in 0.887s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:41 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f Jul 06 12:19:41 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:42 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f" returned: 0 in 0.839s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:42 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f is being set with open permissions: ugo+rw Jul 06 12:19:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:42 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f Jul 06 12:19:42 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:42 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f" returned: 0 in 0.745s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:42 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=91,cinder:SELECT=68,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:42 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=81,cinder:INSERT=28,cinder:DELETE=9,cinder:SELECT=71 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:42 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.info Jul 06 12:19:42 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:43 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.info" returned: 0 in 0.711s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:43 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.info is being set with open permissions: ugo+rw Jul 06 12:19:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:43 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.info Jul 06 12:19:43 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:44 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.info" returned: 0 in 0.794s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.115s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.294s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8477ed44-020f-4e8b-8b94-2ca10274dd9a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-406704d3-8cd3-4dee-84f0-9a4b4a01f957 tempest-VolumesSnapshotListTestJSON-210848089 None] Create snapshot completed successfully Jul 06 12:19:44 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 Jul 06 12:19:44 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:45 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6" returned: 0 in 0.835s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 2G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 2G" returned: 0 in 0.159s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.053s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.114s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Creating offline snapshot 952580de-6ab0-4e38-b801-ab1b6e05d507 of volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8076754-32d7-4116-ac38-6d2f5f5743ce]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-230d2e8c-323a-47c5-aae4-d07962c80155 tempest-VolumesExtendTest-1408249724 None] Extend volume completed successfully. Jul 06 12:19:45 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f Jul 06 12:19:45 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:46 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f" returned: 0 in 0.825s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:46 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 1G Jul 06 12:19:46 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "cinder-689527de-7fd5-4767-a4d9-4f00ddd1f5e4-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-689527de-7fd5-4767-a4d9-4f00ddd1f5e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "cinder-quobyte-40b9abeb-9add-46e0-8a33-3da7efe431b6" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-40b9abeb-9add-46e0-8a33-3da7efe431b6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "cinder-quobyte-689527de-7fd5-4767-a4d9-4f00ddd1f5e4" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-689527de-7fd5-4767-a4d9-4f00ddd1f5e4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Deleting offline snapshot 689527de-7fd5-4767-a4d9-4f00ddd1f5e4 of volume 40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] snapshot_file for this snap is: volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1cf76a-00df-4486-bbe6-c9000d946d5b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:47 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 Jul 06 12:19:47 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:47 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 1G" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:47 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 Jul 06 12:19:47 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:47 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4" returned: 0 in 0.924s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40b9abeb-9add-46e0-8a33-3da7efe431b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:47 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c173a-2d8b-46b1-9f19-fb697df5ebfc]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:48 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 Jul 06 12:19:48 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:48 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507" returned: 0 in 0.902s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:48 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 is being set with open permissions: ugo+rw Jul 06 12:19:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:48 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 Jul 06 12:19:48 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:48 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507" returned: 0 in 0.711s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.466s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:48 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6" returned: 0 in 0.947s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:48 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 Jul 06 12:19:48 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-81e3deef-e0aa-451f-af0f-71bbeedf631c tempest-VolumesSnapshotListTestJSON-210848089 None] Create snapshot completed successfully Jul 06 12:19:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Creating offline snapshot 9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 of volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:19:49 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4" returned: 0 in 0.933s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea468b5b-77d5-453c-b240-a7306c198be8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:49 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4 Jul 06 12:19:49 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:50 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 Jul 06 12:19:50 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:50 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6.689527de-7fd5-4767-a4d9-4f00ddd1f5e4" returned: 0 in 0.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-689527de-7fd5-4767-a4d9-4f00ddd1f5e4" released by "_delete_snapshot" :: held 3.742s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-40b9abeb-9add-46e0-8a33-3da7efe431b6" released by "delete_snapshot" :: held 3.777s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Created reservations ['5ab824bb-bcb0-439d-8c43-e4953e916ac3', 'c1422459-d924-4371-9aef-10dbc07ba78b', '3ee75852-cf8b-4b9b-a021-b69870ab0ac1', '8a33302b-c87f-479e-a15e-c96b72627302'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:50 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507" returned: 0 in 0.949s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:50 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 1G Jul 06 12:19:50 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Delete snapshot completed successfully. Jul 06 12:19:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-506c2104-c53d-408d-9456-bf6255ad70f7 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-689527de-7fd5-4767-a4d9-4f00ddd1f5e4-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "cinder-40b9abeb-9add-46e0-8a33-3da7efe431b6-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-40b9abeb-9add-46e0-8a33-3da7efe431b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "cinder-quobyte-40b9abeb-9add-46e0-8a33-3da7efe431b6" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-40b9abeb-9add-46e0-8a33-3da7efe431b6" acquired by "delete_volume" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff853016-8360-4bcf-b5e8-4a88a48c0879]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:51 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 Jul 06 12:19:51 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:51 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 1G" returned: 0 in 1.152s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:52 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 Jul 06 12:19:52 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:52 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6" returned: 0 in 1.102s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:52 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6 Jul 06 12:19:52 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:52 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" returned: 0 in 0.885s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:52 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 is being set with open permissions: ugo+rw Jul 06 12:19:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:52 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 Jul 06 12:19:52 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:53 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40b9abeb-9add-46e0-8a33-3da7efe431b6" returned: 0 in 0.757s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-quobyte-40b9abeb-9add-46e0-8a33-3da7efe431b6" released by "delete_volume" :: held 1.935s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Created reservations ['2a6d957d-f313-43c6-9094-6495fd75cd31', '6ddfd829-5609-4963-8b17-4daa6e97dd81', 'eaa28534-4eff-4aee-aa8a-f395b8f29ad3', '74134845-5d1b-43a1-9473-28401dda5887'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:53 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:19:53 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:53 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" returned: 0 in 0.796s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.915s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-58573f91-b63b-4247-ac60-05a168e7b198 tempest-VolumesSnapshotListTestJSON-210848089 None] Create snapshot completed successfully Jul 06 12:19:54 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.819s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:54 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:54 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Deleted volume successfully. Jul 06 12:19:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e16ef9fe-883b-493c-b690-d24adc4b22f4 tempest-VolumesExtendTest-1408249724 None] Lock "cinder-40b9abeb-9add-46e0-8a33-3da7efe431b6-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-9ab1f01f-4e9d-4d69-96ed-4677dbde7c70-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-9ab1f01f-4e9d-4d69-96ed-4677dbde7c70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-quobyte-9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Deleting offline snapshot 9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 of volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] snapshot_file for this snap is: volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7565e9-714a-41ee-b491-098ab4eab1ed]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:55 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 Jul 06 12:19:55 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:55 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" returned: 0 in 0.871s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2809aa-afaf-4a04-90cc-81900ca7ab73]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:56 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 Jul 06 12:19:56 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:56 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507" returned: 0 in 0.890s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:19:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:56 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 Jul 06 12:19:56 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:58 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" returned: 0 in 1.143s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:58 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70 Jul 06 12:19:58 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:58 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" returned: 0 in 0.751s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-9ab1f01f-4e9d-4d69-96ed-4677dbde7c70" released by "_delete_snapshot" :: held 3.765s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" released by "delete_snapshot" :: held 3.805s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:58 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Created reservations ['991d251c-1293-47e8-809a-10746e1eb685', '0a642dca-2d83-40c9-b43a-de11cc25733c', '39fe25b3-5974-42f2-8bbc-a8cb0ff88b8e', 'ca7fd8be-d6dd-4f2c-ada1-5304728adb46'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Delete snapshot completed successfully. Jul 06 12:19:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-71a08b4b-0042-4fbb-a482-9ba020d02b98 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-9ab1f01f-4e9d-4d69-96ed-4677dbde7c70-delete_snapshot" released by "delete_snapshot" :: held 4.003s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-952580de-6ab0-4e38-b801-ab1b6e05d507-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-952580de-6ab0-4e38-b801-ab1b6e05d507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-quobyte-952580de-6ab0-4e38-b801-ab1b6e05d507" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-952580de-6ab0-4e38-b801-ab1b6e05d507" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Deleting offline snapshot 952580de-6ab0-4e38-b801-ab1b6e05d507 of volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] snapshot_file for this snap is: volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c455d05-36bb-4a89-9438-5ff77907b1bd]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:59 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 Jul 06 12:19:59 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:00 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507" returned: 0 in 0.936s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[440afa11-d820-4a5e-bffc-8734ceda3f60]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:00 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f Jul 06 12:20:00 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:01 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f" returned: 0 in 0.940s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:01 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 Jul 06 12:20:01 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:02 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507" returned: 0 in 0.871s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:02 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507 Jul 06 12:20:02 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:03 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.952580de-6ab0-4e38-b801-ab1b6e05d507" returned: 0 in 0.877s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-952580de-6ab0-4e38-b801-ab1b6e05d507" released by "_delete_snapshot" :: held 3.747s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" released by "delete_snapshot" :: held 3.778s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Created reservations ['930d7f7c-dab1-442d-9550-099a771b47fe', 'fff40f5b-f51a-48e7-ab0b-543a08e42287', '87169a5b-01e3-4f38-8a41-f1a0099592c5', '1a7ef6f2-d10d-4515-84ee-6606bfcc6050'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:03 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Delete snapshot completed successfully. Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff697d13-dfc4-4398-bfde-562e87e8adde tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-952580de-6ab0-4e38-b801-ab1b6e05d507-delete_snapshot" released by "delete_snapshot" :: held 3.996s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Flow 'volume_create_manager' (5cbcf932-82eb-4f2f-a283-aea0365ef30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b68f93-d7e0-45c2-bc34-b7a5a8ff358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b68f93-d7e0-45c2-bc34-b7a5a8ff358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-976099097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9846c8eb-a845-44dd-b4e5-0698dcadcc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa22c24fab44e21812494cf5c121dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:03Z,use_quota=True,user_id='d992e013a7f842d891dd72217f99cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b549f28-4952-4704-a5cf-0897d109c3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b549f28-4952-4704-a5cf-0897d109c3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f719960-9016-43a4-ae50-ae273eb313ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f719960-9016-43a4-ae50-ae273eb313ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9846c8eb-a845-44dd-b4e5-0698dcadcc52', 'volume_name': 'volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec73f5cf-2877-483a-a961-ff44dd1e75a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec73f5cf-2877-483a-a961-ff44dd1e75a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2c2bcc-cdf0-476b-ab83-7b5b63123838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:03 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Volume 9846c8eb-a845-44dd-b4e5-0698dcadcc52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52', 'volume_size': 1} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-976099097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9846c8eb-a845-44dd-b4e5-0698dcadcc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa22c24fab44e21812494cf5c121dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:03Z,use_quota=True,user_id='d992e013a7f842d891dd72217f99cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Creating volume 9846c8eb-a845-44dd-b4e5-0698dcadcc52 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:03 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:03 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 1073741824 Jul 06 12:20:03 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-9b8c1fcc-1541-45e4-93f7-984aff51b00f-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-9b8c1fcc-1541-45e4-93f7-984aff51b00f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-quobyte-9b8c1fcc-1541-45e4-93f7-984aff51b00f" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-9b8c1fcc-1541-45e4-93f7-984aff51b00f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Deleting offline snapshot 9b8c1fcc-1541-45e4-93f7-984aff51b00f of volume 1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] snapshot_file for this snap is: volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d4e18-775d-440a-bd96-f1ddcef41cc5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:03 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f Jul 06 12:20:03 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:04 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 1073741824" returned: 0 in 1.150s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:04 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 Jul 06 12:20:04 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:04 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f" returned: 0 in 1.155s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:04 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d847530-cc0e-4b92-b162-d8b556f0d051]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:05 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f Jul 06 12:20:05 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:05 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52" returned: 0 in 0.880s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2c2bcc-cdf0-476b-ab83-7b5b63123838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aeafb9-e6d5-472a-983b-e2ac8936f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:05 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Volume volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 (9846c8eb-a845-44dd-b4e5-0698dcadcc52): created successfully Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aeafb9-e6d5-472a-983b-e2ac8936f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Flow 'volume_create_manager' (5cbcf932-82eb-4f2f-a283-aea0365ef30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-86cbd824-5774-40bd-bd79-8c95045231ab tempest-AttachVolumeNegativeTest-1715433974 None] Created volume successfully. Jul 06 12:20:05 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" returned: 0 in 0.997s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:05 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f Jul 06 12:20:05 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:06 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f" returned: 0 in 0.956s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:06 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f Jul 06 12:20:06 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:07 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f.9b8c1fcc-1541-45e4-93f7-984aff51b00f" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-9b8c1fcc-1541-45e4-93f7-984aff51b00f" released by "_delete_snapshot" :: held 4.006s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" released by "delete_snapshot" :: held 4.048s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Created reservations ['6068ea6f-84c3-43b7-96cc-5f23ee224898', 'de720829-3625-4238-8f58-039dc9e5e45b', '8cb69fef-88aa-4930-a435-b9e58a72c8b3', '6ee5c0d5-e0af-4a1f-8cab-d94bf51f96e4'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Delete snapshot completed successfully. Jul 06 12:20:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-178ec63c-02d2-4806-aa56-e105cd993808 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-9b8c1fcc-1541-45e4-93f7-984aff51b00f-delete_snapshot" released by "delete_snapshot" :: held 4.305s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-1df4d59c-a714-49eb-ae5b-ecbb627dd70f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-1df4d59c-a714-49eb-ae5b-ecbb627dd70f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ddc6a-22df-4033-84ad-4e06553d8791]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:09 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f Jul 06 12:20:09 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6add19cc-87f2-4a6a-b318-a84f5c58b17b req-1e0816d5-8872-4b08-9555-bed03cfa80a2 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6add19cc-87f2-4a6a-b318-a84f5c58b17b req-1e0816d5-8872-4b08-9555-bed03cfa80a2 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965a3ad-c741-4319-9781-446bbecdb48e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6add19cc-87f2-4a6a-b318-a84f5c58b17b req-1e0816d5-8872-4b08-9555-bed03cfa80a2 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:10 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 Jul 06 12:20:10 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:10 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" returned: 0 in 1.056s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:10 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f Jul 06 12:20:10 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:11 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6add19cc-87f2-4a6a-b318-a84f5c58b17b req-1e0816d5-8872-4b08-9555-bed03cfa80a2 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52" returned: 0 in 1.022s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6add19cc-87f2-4a6a-b318-a84f5c58b17b req-1e0816d5-8872-4b08-9555-bed03cfa80a2 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:11 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-6add19cc-87f2-4a6a-b318-a84f5c58b17b req-1e0816d5-8872-4b08-9555-bed03cfa80a2 tempest-AttachVolumeNegativeTest-1715433974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad0ffce2-5931-4176-8160-291b972102ca', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" returned: 0 in 0.824s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-quobyte-1df4d59c-a714-49eb-ae5b-ecbb627dd70f" released by "delete_volume" :: held 1.949s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-6add19cc-87f2-4a6a-b318-a84f5c58b17b req-1e0816d5-8872-4b08-9555-bed03cfa80a2 tempest-AttachVolumeNegativeTest-1715433974 None] attachment_update completed successfully. Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Created reservations ['8ca168e5-c68e-460f-8a9a-cabc4cce9ba8', 'd5dd0e38-9475-49b3-a0f9-b6f453ea8e59', '098dfde5-974f-4213-b173-ce1c429eb463', 'c0d85bb3-fa60-459f-bbc3-3ad2db1d5ce6'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:11 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:20:11 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:12 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.770s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Deleted volume successfully. Jul 06 12:20:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0b1e0bb2-e7b7-4193-83cc-972964d6a686 tempest-VolumesSnapshotListTestJSON-210848089 None] Lock "cinder-1df4d59c-a714-49eb-ae5b-ecbb627dd70f-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:21 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=43,cinder:SELECT=44,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:20:22 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=47,cinder:UPDATE=53,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:20:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:20:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:27 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:20:27 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:27 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.946s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:20:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:20:49 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Flow 'volume_create_manager' (7c8b14ec-1b70-487a-b431-de0ffcbe84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3461bc1-9769-432e-814f-eb7104e1c50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3461bc1-9769-432e-814f-eb7104e1c50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-923398910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe553b7e-fee5-4c81-ad57-ff49ec76ff9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04c5f9cc494b5fb684f04900e11cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:50Z,use_quota=True,user_id='52f8a7c667fd4cde9870840a7ee48565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36509416-4961-49b3-809b-1be112103b32),volume_type_id=36509416-4961-49b3-809b-1be112103b32)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9786ae-72e8-460b-8625-dfda65f79ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9786ae-72e8-460b-8625-dfda65f79ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7adcc5-691d-4136-ae8b-c73a46575bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7adcc5-691d-4136-ae8b-c73a46575bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe553b7e-fee5-4c81-ad57-ff49ec76ff9e', 'volume_name': 'volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7e473d-9b90-4221-8f08-2713da13df25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7e473d-9b90-4221-8f08-2713da13df25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7d0d6f-141f-4674-9f28-43d71c2412ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:50 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Volume fe553b7e-fee5-4c81-ad57-ff49ec76ff9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e', 'volume_size': 1} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-923398910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe553b7e-fee5-4c81-ad57-ff49ec76ff9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04c5f9cc494b5fb684f04900e11cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:50Z,use_quota=True,user_id='52f8a7c667fd4cde9870840a7ee48565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36509416-4961-49b3-809b-1be112103b32),volume_type_id=36509416-4961-49b3-809b-1be112103b32)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Creating volume fe553b7e-fee5-4c81-ad57-ff49ec76ff9e {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:50 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:50 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e 1073741824 Jul 06 12:20:50 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Flow 'volume_create_manager' (18dedbf8-7db6-46ec-bb80-a412d9169424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5fb5c1-657f-4bc5-95d2-b0eb735f8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5fb5c1-657f-4bc5-95d2-b0eb735f8254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-312511320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3be67e9-98ab-4509-aa42-2ebe1cc74765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04c5f9cc494b5fb684f04900e11cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:50Z,use_quota=True,user_id='52f8a7c667fd4cde9870840a7ee48565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf7139ec-3b1b-4902-afad-be24e66b60bd),volume_type_id=cf7139ec-3b1b-4902-afad-be24e66b60bd)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7123873f-6af2-4267-acd4-b0daf65cf6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7123873f-6af2-4267-acd4-b0daf65cf6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9488665d-e7a9-4c25-a6ab-9cbfaceb3bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9488665d-e7a9-4c25-a6ab-9cbfaceb3bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3be67e9-98ab-4509-aa42-2ebe1cc74765', 'volume_name': 'volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac562635-7161-4bc1-b5b8-6c182672cc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac562635-7161-4bc1-b5b8-6c182672cc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4559e487-da35-49a0-839a-ad4320e0943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Volume d3be67e9-98ab-4509-aa42-2ebe1cc74765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765', 'volume_size': 1} Jul 06 12:20:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:52 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e 1073741824" returned: 0 in 2.026s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:52 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e Jul 06 12:20:52 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Flow 'volume_create_manager' (c962e14b-68f8-4d4f-9105-e70cc7c27d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b6c961-d18b-4591-b4c3-d7196b5c075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b6c961-d18b-4591-b4c3-d7196b5c075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1437021279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6dacecf-8dfb-4177-8e38-4a870f9d57ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04c5f9cc494b5fb684f04900e11cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:52Z,use_quota=True,user_id='52f8a7c667fd4cde9870840a7ee48565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(583da4ad-b045-44a8-bcfc-14986f357064),volume_type_id=583da4ad-b045-44a8-bcfc-14986f357064)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54b6812-52d0-4944-9546-c9959f9a76ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54b6812-52d0-4944-9546-c9959f9a76ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49ec337-f703-4b20-be77-37f9019ab4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:52 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49ec337-f703-4b20-be77-37f9019ab4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6dacecf-8dfb-4177-8e38-4a870f9d57ed', 'volume_name': 'volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed', 'volume_size': 1, 'image_id': 'ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2083550499', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a04c5f9cc494b5fb684f04900e11cda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'created_at': datetime.datetime(2026, 7, 6, 10, 20, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 20, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312/file', 'properties': {}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd03cb0-d6fb-4c83-8edf-e663841d4a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd03cb0-d6fb-4c83-8edf-e663841d4a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd8c1e-8520-4c06-a95a-ec9239d6a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:53 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Volume f6dacecf-8dfb-4177-8e38-4a870f9d57ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed', 'volume_size': 1, 'image_id': 'ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2083550499', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a04c5f9cc494b5fb684f04900e11cda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'created_at': datetime.datetime(2026, 7, 6, 10, 20, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 20, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312/file', 'properties': {}}, 'image_service': } Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Trying to clone f6dacecf-8dfb-4177-8e38-4a870f9d57ed from image ed376da4-2ed1-47c2-a97f-8d4a197fe312 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:20:53 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e" returned: 0 in 1.487s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] <== create_volume: return (3694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.696s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-312511320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3be67e9-98ab-4509-aa42-2ebe1cc74765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04c5f9cc494b5fb684f04900e11cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:50Z,use_quota=True,user_id='52f8a7c667fd4cde9870840a7ee48565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf7139ec-3b1b-4902-afad-be24e66b60bd),volume_type_id=cf7139ec-3b1b-4902-afad-be24e66b60bd)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Creating volume d3be67e9-98ab-4509-aa42-2ebe1cc74765 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:53 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:53 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 1073741824 Jul 06 12:20:53 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7d0d6f-141f-4674-9f28-43d71c2412ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19158393-1e14-4380-a76c-f1fcc21f8e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:53 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Volume volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e (fe553b7e-fee5-4c81-ad57-ff49ec76ff9e): created successfully Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19158393-1e14-4380-a76c-f1fcc21f8e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Flow 'volume_create_manager' (7c8b14ec-1b70-487a-b431-de0ffcbe84b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c5c8d53e-04b9-4c1e-b415-4033d1bf4d86 tempest-TestInstancesWithCinderVolumes-952069405 None] Created volume successfully. Jul 06 12:20:55 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 1073741824" returned: 0 in 1.468s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:55 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 Jul 06 12:20:55 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Flow 'volume_create_manager' (b559010e-d750-499c-8952-865549d37006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1e553e-4fc1-4fcf-b2cc-aa044fea0168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1e553e-4fc1-4fcf-b2cc-aa044fea0168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-434602066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f8d53b-4791-4d6c-aa6a-7372c311fef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b56b543666074bc6b4ece91b3150479c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:55Z,use_quota=True,user_id='1dddac6eb07a4beda3db0e257a404cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11719212-0486-4dbf-a11e-6628a2db23d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11719212-0486-4dbf-a11e-6628a2db23d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d4b7d9-a6cb-434b-b89a-c59bddbeb62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d4b7d9-a6cb-434b-b89a-c59bddbeb62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f8d53b-4791-4d6c-aa6a-7372c311fef2', 'volume_name': 'volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cd3c29-f6b4-4fad-a542-253c098eb734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cd3c29-f6b4-4fad-a542-253c098eb734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7e78e-2449-454e-8a40-989c518d8528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Volume c8f8d53b-4791-4d6c-aa6a-7372c311fef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2', 'volume_size': 1} Jul 06 12:20:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:56 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765" returned: 0 in 1.006s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] <== create_volume: return (2561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.565s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-434602066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f8d53b-4791-4d6c-aa6a-7372c311fef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b56b543666074bc6b4ece91b3150479c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:55Z,use_quota=True,user_id='1dddac6eb07a4beda3db0e257a404cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Creating volume c8f8d53b-4791-4d6c-aa6a-7372c311fef2 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:56 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:56 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 1073741824 Jul 06 12:20:56 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4559e487-da35-49a0-839a-ad4320e0943a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039b439d-cbda-4514-9e01-cfb0059057eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Volume volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 (d3be67e9-98ab-4509-aa42-2ebe1cc74765): created successfully Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039b439d-cbda-4514-9e01-cfb0059057eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Flow 'volume_create_manager' (18dedbf8-7db6-46ec-bb80-a412d9169424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8d654fc3-2b3f-45a1-87fc-b15cd0b3555a tempest-TestInstancesWithCinderVolumes-952069405 None] Created volume successfully. Jul 06 12:20:57 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 1073741824" returned: 0 in 1.243s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:57 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 Jul 06 12:20:57 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD, size 20.69 MB, duration 4.95 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:20:58 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Image download 20.69 MB at 4.18 MB/s Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4b55cd-7234-410e-8c69-f8218b80249f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:58 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2" returned: 0 in 0.945s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7e78e-2449-454e-8a40-989c518d8528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce76a46-59a0-4705-ad3a-9bab62502916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:58 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Volume volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 (c8f8d53b-4791-4d6c-aa6a-7372c311fef2): created successfully Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce76a46-59a0-4705-ad3a-9bab62502916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Flow 'volume_create_manager' (b559010e-d750-499c-8952-865549d37006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:58 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD Jul 06 12:20:58 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b2c5131d-b2c3-4fbb-b402-3ba1308ec017 tempest-TestMinimumBasicScenario-234920597 None] Created volume successfully. Jul 06 12:20:59 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD" returned: 0 in 1.012s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:59 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Temporary image ed376da4-2ed1-47c2-a97f-8d4a197fe312 is fetched for user 52f8a7c667fd4cde9870840a7ee48565. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:20:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ecf8c0-21e7-4f03-9aa2-df69c549421b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:59 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD Jul 06 12:20:59 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:00 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1437021279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6dacecf-8dfb-4177-8e38-4a870f9d57ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04c5f9cc494b5fb684f04900e11cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:52Z,use_quota=True,user_id='52f8a7c667fd4cde9870840a7ee48565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(583da4ad-b045-44a8-bcfc-14986f357064),volume_type_id=583da4ad-b045-44a8-bcfc-14986f357064)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Creating volume f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:00 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:21:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:00 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed 1073741824 Jul 06 12:21:00 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:01 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed 1073741824" returned: 0 in 0.876s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:01 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:21:01 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:02 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 0 in 0.721s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Attempting download of ed376da4-2ed1-47c2-a97f-8d4a197fe312 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'metadata': {}}])) to volume f6dacecf-8dfb-4177-8e38-4a870f9d57ed. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[753fc893-8bef-4c4a-b471-747316de1422]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed376da4-2ed1-47c2-a97f-8d4a197fe312_0vhyrith {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:02 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed376da4-2ed1-47c2-a97f-8d4a197fe312_0vhyrith Jul 06 12:21:02 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:02 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed376da4-2ed1-47c2-a97f-8d4a197fe312_0vhyrith" returned: 0 in 0.866s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed376da4-2ed1-47c2-a97f-8d4a197fe312_0vhyrith {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:03 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed376da4-2ed1-47c2-a97f-8d4a197fe312_0vhyrith Jul 06 12:21:03 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-7e361e28-09d0-4bca-938f-054e6c08cc19 req-4878342b-32bc-487a-943e-9d2b0f61c8f6 tempest-TestMinimumBasicScenario-234920597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-7e361e28-09d0-4bca-938f-054e6c08cc19 req-4878342b-32bc-487a-943e-9d2b0f61c8f6 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9489eb2-9914-40b7-a8d3-8e813f5268db]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-7e361e28-09d0-4bca-938f-054e6c08cc19 req-4878342b-32bc-487a-943e-9d2b0f61c8f6 tempest-TestMinimumBasicScenario-234920597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:03 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 Jul 06 12:21:03 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:03 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed376da4-2ed1-47c2-a97f-8d4a197fe312_0vhyrith" returned: 1 in 0.860s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed376da4-2ed1-47c2-a97f-8d4a197fe312_0vhyrith' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6313c-9edf-4a9a-be78-bea19ed3d1f7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:03 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD Jul 06 12:21:03 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:04 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-7e361e28-09d0-4bca-938f-054e6c08cc19 req-4878342b-32bc-487a-943e-9d2b0f61c8f6 tempest-TestMinimumBasicScenario-234920597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2" returned: 0 in 0.979s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-7e361e28-09d0-4bca-938f-054e6c08cc19 req-4878342b-32bc-487a-943e-9d2b0f61c8f6 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.019s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-7e361e28-09d0-4bca-938f-054e6c08cc19 req-4878342b-32bc-487a-943e-9d2b0f61c8f6 tempest-TestMinimumBasicScenario-234920597 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b03d4b8d-d0c8-442c-a591-ac056d17eada', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:21:04 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-7e361e28-09d0-4bca-938f-054e6c08cc19 req-4878342b-32bc-487a-943e-9d2b0f61c8f6 tempest-TestMinimumBasicScenario-234920597 None] attachment_update completed successfully. Jul 06 12:21:04 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD" returned: 0 in 1.030s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:04 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] ed376da4-2ed1-47c2-a97f-8d4a197fe312 was qcow2, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:21:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:04 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:21:04 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:07 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 0 in 2.179s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:07 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ed376da4-2ed1-47c2-a97f-8d4a197fe312_wci2__qrdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:21:07 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Converted 112.00 MB image at 51.36 MB/s Jul 06 12:21:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:07 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed 1G Jul 06 12:21:07 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:07 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed 1G" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cdd664-862f-4ab6-b012-884785fe1c54]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:08 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:21:08 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:08 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 0 in 0.849s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:08 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:21:08 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:09 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 1 in 0.851s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Downloaded image ed376da4-2ed1-47c2-a97f-8d4a197fe312 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'metadata': {}}])) to volume f6dacecf-8dfb-4177-8e38-4a870f9d57ed successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Temporary image ed376da4-2ed1-47c2-a97f-8d4a197fe312 for user 52f8a7c667fd4cde9870840a7ee48565 is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Marking volume f6dacecf-8dfb-4177-8e38-4a870f9d57ed as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Copying metadata from image ed376da4-2ed1-47c2-a97f-8d4a197fe312 to f6dacecf-8dfb-4177-8e38-4a870f9d57ed. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Creating volume glance metadata for volume f6dacecf-8dfb-4177-8e38-4a870f9d57ed backed by image ed376da4-2ed1-47c2-a97f-8d4a197fe312 with: {'image_id': 'ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'image_name': 'tempest-scenario-img--2083550499', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd8c1e-8520-4c06-a95a-ec9239d6a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed', 'volume_size': 1, 'image_id': 'ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2083550499', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a04c5f9cc494b5fb684f04900e11cda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed376da4-2ed1-47c2-a97f-8d4a197fe312', 'created_at': datetime.datetime(2026, 7, 6, 10, 20, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 20, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed376da4-2ed1-47c2-a97f-8d4a197fe312/file', 'properties': {}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2297d9c4-c483-4578-8e67-fed7e6bd3217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:09 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Volume volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed (f6dacecf-8dfb-4177-8e38-4a870f9d57ed): created successfully Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2297d9c4-c483-4578-8e67-fed7e6bd3217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Flow 'volume_create_manager' (c962e14b-68f8-4d4f-9105-e70cc7c27d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d6356637-aa92-4f32-9de4-fc51e1bee32b tempest-TestInstancesWithCinderVolumes-952069405 None] Created volume successfully. Jul 06 12:21:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:18 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6234d27a-9048-4187-b812-b5b7ac419a2a]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:18 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:21:18 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:19 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 0 in 0.986s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:19 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:21:19 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:19 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 1 in 0.875s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.940s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fd0c37c-f5f4-4ad3-97e6-66c4c2b05a65', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:21:19 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-62c94b94-be5e-4954-8261-ebf83f95c4ad req-89948042-3d50-4e8f-b85d-af806f00248d tempest-TestInstancesWithCinderVolumes-952069405 None] attachment_update completed successfully. Jul 06 12:21:21 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-e5ac273c-a205-4f83-b312-be8047fbd3b3 req-a72aee30-eb07-44ea-ba64-6a50993d463f tempest-AttachVolumeNegativeTest-1715433974 None] Terminate volume connection completed successfully. Jul 06 12:21:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-e5ac273c-a205-4f83-b312-be8047fbd3b3 req-a72aee30-eb07-44ea-ba64-6a50993d463f tempest-AttachVolumeNegativeTest-1715433974 None] Deleting attachment ad0ffce2-5931-4176-8160-291b972102ca. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:21:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:21:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:27 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:21:27 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:28 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.076s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:21:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:21:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:21:31 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=29,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:21:31 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=22,cinder:UPDATE=19,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:21:47 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:21:47 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:22:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9999c448-e85a-4df4-bff2-4441e9ad7cb9 req-bbb97d75-6f7d-4cd4-9295-14d3f8c1be72 tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9999c448-e85a-4df4-bff2-4441e9ad7cb9 req-bbb97d75-6f7d-4cd4-9295-14d3f8c1be72 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1467f17d-97cc-4515-8dec-6e5843b2b92a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-9999c448-e85a-4df4-bff2-4441e9ad7cb9 req-bbb97d75-6f7d-4cd4-9295-14d3f8c1be72 tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:00 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e Jul 06 12:22:01 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:01 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-9999c448-e85a-4df4-bff2-4441e9ad7cb9 req-bbb97d75-6f7d-4cd4-9295-14d3f8c1be72 tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e" returned: 0 in 1.026s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9999c448-e85a-4df4-bff2-4441e9ad7cb9 req-bbb97d75-6f7d-4cd4-9295-14d3f8c1be72 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.052s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9999c448-e85a-4df4-bff2-4441e9ad7cb9 req-bbb97d75-6f7d-4cd4-9295-14d3f8c1be72 tempest-TestInstancesWithCinderVolumes-952069405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bfc7349-e237-4195-9bfc-23d5b97ff262', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:22:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-9999c448-e85a-4df4-bff2-4441e9ad7cb9 req-bbb97d75-6f7d-4cd4-9295-14d3f8c1be72 tempest-TestInstancesWithCinderVolumes-952069405 None] attachment_update completed successfully. Jul 06 12:22:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-a9ac7087-cac2-40f3-a409-bdf2230a63c8 req-706930b4-d63a-4371-b0da-8e89502165a9 tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-a9ac7087-cac2-40f3-a409-bdf2230a63c8 req-706930b4-d63a-4371-b0da-8e89502165a9 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[26989cd5-ef64-485f-88d2-ba05fe460fa8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-a9ac7087-cac2-40f3-a409-bdf2230a63c8 req-706930b4-d63a-4371-b0da-8e89502165a9 tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:10 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 Jul 06 12:22:10 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:11 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-a9ac7087-cac2-40f3-a409-bdf2230a63c8 req-706930b4-d63a-4371-b0da-8e89502165a9 tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765" returned: 0 in 0.915s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-a9ac7087-cac2-40f3-a409-bdf2230a63c8 req-706930b4-d63a-4371-b0da-8e89502165a9 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-a9ac7087-cac2-40f3-a409-bdf2230a63c8 req-706930b4-d63a-4371-b0da-8e89502165a9 tempest-TestInstancesWithCinderVolumes-952069405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5b55334-272d-4210-8b52-0d630a249949', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:22:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-a9ac7087-cac2-40f3-a409-bdf2230a63c8 req-706930b4-d63a-4371-b0da-8e89502165a9 tempest-TestInstancesWithCinderVolumes-952069405 None] attachment_update completed successfully. Jul 06 12:22:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-6d78275e-733a-4d28-a171-631784ab3da7 req-26751ab0-8766-4cb0-af16-735bc5a27f57 tempest-TestMinimumBasicScenario-234920597 None] Terminate volume connection completed successfully. Jul 06 12:22:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-6d78275e-733a-4d28-a171-631784ab3da7 req-26751ab0-8766-4cb0-af16-735bc5a27f57 tempest-TestMinimumBasicScenario-234920597 None] Deleting attachment b03d4b8d-d0c8-442c-a591-ac056d17eada. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:22:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Acquiring lock "cinder-c8f8d53b-4791-4d6c-aa6a-7372c311fef2-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Lock "cinder-c8f8d53b-4791-4d6c-aa6a-7372c311fef2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Acquiring lock "cinder-quobyte-c8f8d53b-4791-4d6c-aa6a-7372c311fef2" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Lock "cinder-quobyte-c8f8d53b-4791-4d6c-aa6a-7372c311fef2" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41add45-6f66-418e-8574-0d787a42dbdd]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:14 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 Jul 06 12:22:14 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:15 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2" returned: 0 in 0.958s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:15 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2 Jul 06 12:22:15 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Flow 'volume_create_manager' (80ce3de4-b7b0-4c6d-9a6c-31c51dd163f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84062a20-84ce-448c-b376-fd0b602816d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84062a20-84ce-448c-b376-fd0b602816d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-74308800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccd9a28-fe6c-433b-b3e1-008a71b8e787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa22c24fab44e21812494cf5c121dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:16Z,use_quota=True,user_id='d992e013a7f842d891dd72217f99cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634cd93a-47f3-4b29-9584-c882b6251132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634cd93a-47f3-4b29-9584-c882b6251132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ee891f-d89a-4f80-9caa-a642b72fcc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ee891f-d89a-4f80-9caa-a642b72fcc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ccd9a28-fe6c-433b-b3e1-008a71b8e787', 'volume_name': 'volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7952f530-61e8-4607-9178-282ae18fad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7952f530-61e8-4607-9178-282ae18fad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f6a6af-d0b2-4c08-aeca-0f84a939491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Volume 5ccd9a28-fe6c-433b-b3e1-008a71b8e787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787', 'volume_size': 1} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-74308800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccd9a28-fe6c-433b-b3e1-008a71b8e787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa22c24fab44e21812494cf5c121dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:16Z,use_quota=True,user_id='d992e013a7f842d891dd72217f99cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Creating volume 5ccd9a28-fe6c-433b-b3e1-008a71b8e787 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:15 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:22:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:15 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 1073741824 Jul 06 12:22:15 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:16 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c8f8d53b-4791-4d6c-aa6a-7372c311fef2" returned: 0 in 0.840s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Lock "cinder-quobyte-c8f8d53b-4791-4d6c-aa6a-7372c311fef2" released by "delete_volume" :: held 1.843s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Created reservations ['8b867752-1580-4a17-ab25-8e88a367bbe6', '6f518d46-9ea3-4ca1-a7d4-4d4cd34831af', '9b6b6496-4439-429c-843f-1dd7b076e7cb', '148101ae-790e-4e63-a250-cd815ce5ddcd'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:16 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:22:16 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:17 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 1073741824" returned: 0 in 1.098s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:17 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 Jul 06 12:22:17 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:17 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.928s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Deleted volume successfully. Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3c91d6a5-bce3-456c-b90d-be1b70d4f714 tempest-TestMinimumBasicScenario-234920597 None] Lock "cinder-c8f8d53b-4791-4d6c-aa6a-7372c311fef2-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:17 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787" returned: 0 in 0.756s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f6a6af-d0b2-4c08-aeca-0f84a939491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032880d7-8e05-4bdf-a09d-f69e1feb3a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:17 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Volume volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 (5ccd9a28-fe6c-433b-b3e1-008a71b8e787): created successfully Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032880d7-8e05-4bdf-a09d-f69e1feb3a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Flow 'volume_create_manager' (80ce3de4-b7b0-4c6d-9a6c-31c51dd163f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d5dd1854-a5ca-4212-94a5-1894cd43275b tempest-AttachVolumeNegativeTest-1715433974 None] Created volume successfully. Jul 06 12:22:21 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-0e0462d8-c015-49a5-ab13-c18574817627 req-8b015f11-70a7-4921-b460-9b433361e23f tempest-TestInstancesWithCinderVolumes-952069405 None] Terminate volume connection completed successfully. Jul 06 12:22:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-0e0462d8-c015-49a5-ab13-c18574817627 req-8b015f11-70a7-4921-b460-9b433361e23f tempest-TestInstancesWithCinderVolumes-952069405 None] Deleting attachment 7bfc7349-e237-4195-9bfc-23d5b97ff262. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-bc050cdc-3f4d-47aa-b138-d28ca9b57a82 req-de428497-bfbb-4de7-8c55-c80f1e03d86f tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-bc050cdc-3f4d-47aa-b138-d28ca9b57a82 req-de428497-bfbb-4de7-8c55-c80f1e03d86f tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[da496e42-a440-4bff-91b0-49e86c086950]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-bc050cdc-3f4d-47aa-b138-d28ca9b57a82 req-de428497-bfbb-4de7-8c55-c80f1e03d86f tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:22 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 Jul 06 12:22:22 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "cinder-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "cinder-quobyte-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-quobyte-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f9f241-afa5-455d-8287-aa340c91edcb]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:22 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e Jul 06 12:22:22 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:23 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-bc050cdc-3f4d-47aa-b138-d28ca9b57a82 req-de428497-bfbb-4de7-8c55-c80f1e03d86f tempest-AttachVolumeNegativeTest-1715433974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787" returned: 0 in 1.048s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-bc050cdc-3f4d-47aa-b138-d28ca9b57a82 req-de428497-bfbb-4de7-8c55-c80f1e03d86f tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.067s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-bc050cdc-3f4d-47aa-b138-d28ca9b57a82 req-de428497-bfbb-4de7-8c55-c80f1e03d86f tempest-AttachVolumeNegativeTest-1715433974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d5eefcf-401a-41bd-afc9-f5f77874a9c2', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:22:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-bc050cdc-3f4d-47aa-b138-d28ca9b57a82 req-de428497-bfbb-4de7-8c55-c80f1e03d86f tempest-AttachVolumeNegativeTest-1715433974 None] attachment_update completed successfully. Jul 06 12:22:23 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e" returned: 0 in 0.946s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:23 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e Jul 06 12:22:23 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:24 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e" returned: 0 in 0.853s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-quobyte-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e" released by "delete_volume" :: held 1.850s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:24 devstack cinder-volume[86706]: WARNING cinder.quota [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039441591-1562102677 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039441591-1562102677, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:24 devstack cinder-volume[86706]: WARNING cinder.quota [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039441591-1562102677 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2039441591-1562102677, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Created reservations ['89e64947-c9fb-43d6-8e03-fcdf93c5072a', '82499550-afed-4205-bc63-284081b352f2', '3a6dc12b-f1fb-4ed5-995a-6d04d04162fe', 'cf5c9316-1f7b-474b-a527-449ae8b5bcf3'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:24 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:22:24 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:25 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.865s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:25 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Deleted volume successfully. Jul 06 12:22:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4cef6eae-0f11-4efb-87ad-c3dc79c75fef tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-fe553b7e-fee5-4c81-ad57-ff49ec76ff9e-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:22:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:27 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:22:27 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:27 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.824s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:22:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:22:28 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-413679a9-9102-41d2-bb20-ec3d8c8fda6c req-d033034e-85e0-4050-bd56-7074abec6645 tempest-TestInstancesWithCinderVolumes-952069405 None] Terminate volume connection completed successfully. Jul 06 12:22:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-413679a9-9102-41d2-bb20-ec3d8c8fda6c req-d033034e-85e0-4050-bd56-7074abec6645 tempest-TestInstancesWithCinderVolumes-952069405 None] Deleting attachment f5b55334-272d-4210-8b52-0d630a249949. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:22:29 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-5172b67d-40bd-492a-aec2-a2f1b873f1c1 req-ca14cfff-62d7-41d8-8aef-f9b9a79049ff tempest-AttachVolumeNegativeTest-1715433974 None] Terminate volume connection completed successfully. Jul 06 12:22:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-5172b67d-40bd-492a-aec2-a2f1b873f1c1 req-ca14cfff-62d7-41d8-8aef-f9b9a79049ff tempest-AttachVolumeNegativeTest-1715433974 None] Deleting attachment 9d5eefcf-401a-41bd-afc9-f5f77874a9c2. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:22:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "cinder-d3be67e9-98ab-4509-aa42-2ebe1cc74765-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-d3be67e9-98ab-4509-aa42-2ebe1cc74765-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "cinder-quobyte-d3be67e9-98ab-4509-aa42-2ebe1cc74765" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-quobyte-d3be67e9-98ab-4509-aa42-2ebe1cc74765" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:30 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a551135e-29a3-4787-9205-d9f37db418de]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:30 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 Jul 06 12:22:30 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:31 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765" returned: 0 in 1.035s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:31 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765 Jul 06 12:22:31 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:32 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d3be67e9-98ab-4509-aa42-2ebe1cc74765" returned: 0 in 1.256s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-quobyte-d3be67e9-98ab-4509-aa42-2ebe1cc74765" released by "delete_volume" :: held 2.367s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:32 devstack cinder-volume[86706]: WARNING cinder.quota [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107674816-27457096 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107674816-27457096, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:32 devstack cinder-volume[86706]: WARNING cinder.quota [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107674816-27457096 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107674816-27457096, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Created reservations ['1d3e7093-cc66-4e5b-9f54-fdc217207e9b', '799aa5d0-de20-488f-afeb-4864f69e149f', '6ca4e3be-5aa2-4f15-9bd5-412620193327', 'c46777e9-e7f8-490a-b6b4-a4460a00121d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:32 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:22:32 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:33 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.282s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:33 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Deleted volume successfully. Jul 06 12:22:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8430c85e-fb78-4c4e-93ee-115e268f15b6 tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-d3be67e9-98ab-4509-aa42-2ebe1cc74765-delete_volume" released by "delete_volume" :: held 3.988s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:38 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-b23028b3-c1fc-466b-a99c-31897a4dee2c req-5ab8da9a-760e-4437-9162-64ee16856f1f tempest-TestInstancesWithCinderVolumes-952069405 None] Terminate volume connection completed successfully. Jul 06 12:22:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-b23028b3-c1fc-466b-a99c-31897a4dee2c req-5ab8da9a-760e-4437-9162-64ee16856f1f tempest-TestInstancesWithCinderVolumes-952069405 None] Deleting attachment 6fd0c37c-f5f4-4ad3-97e6-66c4c2b05a65. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (894eb3a4-c2c9-4709-aeca-0b988215da20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2986e39a-71fa-401a-a4e9-e2114421da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2986e39a-71fa-401a-a4e9-e2114421da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164203340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8980d1fe-397f-4423-8e03-e3a896ffcf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:41Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6b3f24-ae3d-4348-af30-e6ba70302e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6b3f24-ae3d-4348-af30-e6ba70302e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8fe307-ab61-4682-81b2-129d1cd7f6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8fe307-ab61-4682-81b2-129d1cd7f6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8980d1fe-397f-4423-8e03-e3a896ffcf90', 'volume_name': 'volume-8980d1fe-397f-4423-8e03-e3a896ffcf90', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574d5408-a410-47b3-a60d-14b81ac6a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574d5408-a410-47b3-a60d-14b81ac6a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb05eb0-1df8-4b06-8df2-59249620a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:40 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume 8980d1fe-397f-4423-8e03-e3a896ffcf90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8980d1fe-397f-4423-8e03-e3a896ffcf90', 'volume_size': 1} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164203340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8980d1fe-397f-4423-8e03-e3a896ffcf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:41Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Creating volume 8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:40 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:22:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:40 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 1073741824 Jul 06 12:22:40 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:41 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 1073741824" returned: 0 in 1.185s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:41 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 Jul 06 12:22:41 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:42 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90" returned: 0 in 0.751s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "cinder-f6dacecf-8dfb-4177-8e38-4a870f9d57ed-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb05eb0-1df8-4b06-8df2-59249620a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8980d1fe-397f-4423-8e03-e3a896ffcf90', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0731b8-70e1-461e-998c-7031407feb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-f6dacecf-8dfb-4177-8e38-4a870f9d57ed-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:42 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 (8980d1fe-397f-4423-8e03-e3a896ffcf90): created successfully Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0731b8-70e1-461e-998c-7031407feb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (894eb3a4-c2c9-4709-aeca-0b988215da20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "cinder-quobyte-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-32f21a25-452b-45fa-9ca6-d851f1bb2a78 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created volume successfully. Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-quobyte-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652dfca-7cf8-46b7-84ff-e5d4a22803c4]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:43 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:22:43 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:43 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 0 in 0.930s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:43 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:22:43 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Creating offline snapshot 8a3c532c-daa7-490e-a798-6feff31f7bda of volume 8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae942deb-85ea-41ed-9b51-720c1462bdc9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:44 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 Jul 06 12:22:44 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:44 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 1 in 0.927s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:22:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:44 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed Jul 06 12:22:44 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:45 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90" returned: 0 in 0.913s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:45 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda 1G Jul 06 12:22:45 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:45 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" returned: 0 in 0.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-quobyte-f6dacecf-8dfb-4177-8e38-4a870f9d57ed" released by "delete_volume" :: held 2.713s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:45 devstack cinder-volume[86706]: WARNING cinder.quota [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130216655-1023337030 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130216655-1023337030, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:45 devstack cinder-volume[86706]: WARNING cinder.quota [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130216655-1023337030 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130216655-1023337030, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Created reservations ['692885cf-d4ab-491f-841b-ef0cd1384fc5', '1df68e1e-6b95-4def-993e-e6c2cbb028dd', '5cc80425-5ec5-49ae-8ab2-c50771258c29', 'c8f3bf93-9683-4619-8600-f23923644328'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:45 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:22:45 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:46 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda 1G" returned: 0 in 1.012s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:46 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda Jul 06 12:22:46 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:46 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.852s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:46 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Deleted volume successfully. Jul 06 12:22:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-765c0510-1bf1-4257-be2b-622af23adf4b tempest-TestInstancesWithCinderVolumes-952069405 None] Lock "cinder-f6dacecf-8dfb-4177-8e38-4a870f9d57ed-delete_volume" released by "delete_volume" :: held 3.873s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:47 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda" returned: 0 in 0.996s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:47 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda is being set with open permissions: ugo+rw Jul 06 12:22:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:47 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda Jul 06 12:22:47 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:47 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:47 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.info Jul 06 12:22:47 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:48 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.info" returned: 0 in 0.814s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:48 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.info is being set with open permissions: ugo+rw Jul 06 12:22:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:48 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.info Jul 06 12:22:48 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:49 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.info" returned: 0 in 0.784s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.394s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e40bb49e-bd41-4187-8c3f-80a3dbee08c9 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Create snapshot completed successfully Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (7f493851-8395-47a6-8f71-78d8fb092205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d3008e-22a7-4234-b96c-119d65845949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d3008e-22a7-4234-b96c-119d65845949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1626766549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609d41d7-0420-427a-b2b6-7a201f76b08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:51Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efdab68-33b8-43c5-8f2e-d5889d61227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efdab68-33b8-43c5-8f2e-d5889d61227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fe8403-e6ea-4a26-9dfd-4b074778bbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fe8403-e6ea-4a26-9dfd-4b074778bbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609d41d7-0420-427a-b2b6-7a201f76b08f', 'volume_name': 'volume-609d41d7-0420-427a-b2b6-7a201f76b08f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b769b0cb-4c09-4782-a8fd-aec3cf799137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b769b0cb-4c09-4782-a8fd-aec3cf799137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad559b2a-6aa8-4b2c-abc9-d09a7fb1fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume 609d41d7-0420-427a-b2b6-7a201f76b08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609d41d7-0420-427a-b2b6-7a201f76b08f', 'volume_size': 1} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1626766549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609d41d7-0420-427a-b2b6-7a201f76b08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:51Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Creating volume 609d41d7-0420-427a-b2b6-7a201f76b08f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:51 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:51 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f 1073741824 Jul 06 12:22:51 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (f413d2f4-0ce2-4ad0-b0af-f2e2032feaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694712ac-1ea6-45a0-bef7-3006400d0cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694712ac-1ea6-45a0-bef7-3006400d0cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197166904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69918e82-23da-491b-8c61-9608efcd6568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:52Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a195cb-8c46-4b1a-a22a-d24708748f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a195cb-8c46-4b1a-a22a-d24708748f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7babb997-b007-49cc-bcdf-4f474878103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7babb997-b007-49cc-bcdf-4f474878103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69918e82-23da-491b-8c61-9608efcd6568', 'volume_name': 'volume-69918e82-23da-491b-8c61-9608efcd6568', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e437f3a6-9850-4b35-b4e8-6bb6dc106b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e437f3a6-9850-4b35-b4e8-6bb6dc106b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f58afb-f588-4870-853d-a4d3b857e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume 69918e82-23da-491b-8c61-9608efcd6568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69918e82-23da-491b-8c61-9608efcd6568', 'volume_size': 1} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (cd118d07-5a18-409a-891e-fc2a2d01b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af899c31-5aeb-4d28-833f-7bc546b31c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af899c31-5aeb-4d28-833f-7bc546b31c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474870654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a360bf2e-4b02-4905-8e9a-4e4488246dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:52Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7bd65b-637e-4779-8c5a-dd36db3532e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7bd65b-637e-4779-8c5a-dd36db3532e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8f1c9a-8776-4262-833e-3cc3febab91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8f1c9a-8776-4262-833e-3cc3febab91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a360bf2e-4b02-4905-8e9a-4e4488246dc3', 'volume_name': 'volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a733f3-8e81-4899-9955-dcb672db981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a733f3-8e81-4899-9955-dcb672db981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01714b5-cd0a-4d07-b3b3-180797730842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume a360bf2e-4b02-4905-8e9a-4e4488246dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3', 'volume_size': 1} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (da16348e-d4fc-4728-97a9-441de3d732e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:52 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8477315-8224-498a-b9ea-8467587e6f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f 1073741824" returned: 0 in 1.641s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8477315-8224-498a-b9ea-8467587e6f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822843115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79476dc0-1efd-4d0a-942d-7215c8e1d865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:53Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b806878b-59c6-4c25-9326-ceadcff9f240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b806878b-59c6-4c25-9326-ceadcff9f240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba59d5f-6556-45b2-97ed-bf2156e5849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba59d5f-6556-45b2-97ed-bf2156e5849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79476dc0-1efd-4d0a-942d-7215c8e1d865', 'volume_name': 'volume-79476dc0-1efd-4d0a-942d-7215c8e1d865', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491d89c-b880-4317-b92e-9074abf378e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491d89c-b880-4317-b92e-9074abf378e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e2c3db-c3b4-433e-ae38-05c61b033d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume 79476dc0-1efd-4d0a-942d-7215c8e1d865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79476dc0-1efd-4d0a-942d-7215c8e1d865', 'volume_size': 1} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:53 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f Jul 06 12:22:53 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (b40aefe3-a077-421e-aca0-06972f9bf970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc51e74-6f7e-46b6-ba5a-e73191558673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc51e74-6f7e-46b6-ba5a-e73191558673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1940139595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3526077b-3f4d-4562-b773-b60fbeb69bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:53Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82cd7bc-c78a-4441-8ce7-a0098e66029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82cd7bc-c78a-4441-8ce7-a0098e66029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629ce4b9-057f-4241-bea6-a59fdc8cd476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629ce4b9-057f-4241-bea6-a59fdc8cd476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3526077b-3f4d-4562-b773-b60fbeb69bd4', 'volume_name': 'volume-3526077b-3f4d-4562-b773-b60fbeb69bd4', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11149cb5-e300-4089-adda-e64501d68527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11149cb5-e300-4089-adda-e64501d68527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddef725-94e8-449a-a0e6-b4ed977441ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:53 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume 3526077b-3f4d-4562-b773-b60fbeb69bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3526077b-3f4d-4562-b773-b60fbeb69bd4', 'volume_size': 1} Jul 06 12:22:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:54 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f" returned: 0 in 1.164s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] <== create_volume: return (2963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.968s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.054s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1197166904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69918e82-23da-491b-8c61-9608efcd6568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:52Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Creating volume 69918e82-23da-491b-8c61-9608efcd6568 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:54 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:54 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 1073741824 Jul 06 12:22:54 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad559b2a-6aa8-4b2c-abc9-d09a7fb1fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609d41d7-0420-427a-b2b6-7a201f76b08f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a59ec8-2299-4c9a-947c-98008201de6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:54 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume volume-609d41d7-0420-427a-b2b6-7a201f76b08f (609d41d7-0420-427a-b2b6-7a201f76b08f): created successfully Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a59ec8-2299-4c9a-947c-98008201de6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (7f493851-8395-47a6-8f71-78d8fb092205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:54 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7af36f86-3a08-405e-9535-5728229f5083 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created volume successfully. Jul 06 12:22:55 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 1073741824" returned: 0 in 1.196s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:55 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 Jul 06 12:22:55 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:56 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568" returned: 0 in 0.734s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.681s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474870654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a360bf2e-4b02-4905-8e9a-4e4488246dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:52Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Creating volume a360bf2e-4b02-4905-8e9a-4e4488246dc3 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:56 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:56 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 1073741824 Jul 06 12:22:56 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f58afb-f588-4870-853d-a4d3b857e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69918e82-23da-491b-8c61-9608efcd6568', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7555ee4-691f-4fb3-b410-c6b12b339fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume volume-69918e82-23da-491b-8c61-9608efcd6568 (69918e82-23da-491b-8c61-9608efcd6568): created successfully Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7555ee4-691f-4fb3-b410-c6b12b339fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (f413d2f4-0ce2-4ad0-b0af-f2e2032feaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-43d34a19-aecc-4ba9-a3c3-560fd6b28b86 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created volume successfully. Jul 06 12:22:57 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 1073741824" returned: 0 in 1.175s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:57 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=56,cinder:UPDATE=53,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:22:57 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=57,cinder:UPDATE=51,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:22:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:57 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 Jul 06 12:22:57 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:58 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3" returned: 0 in 0.865s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.350s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822843115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79476dc0-1efd-4d0a-942d-7215c8e1d865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:53Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Creating volume 79476dc0-1efd-4d0a-942d-7215c8e1d865 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:58 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:58 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 1073741824 Jul 06 12:22:58 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01714b5-cd0a-4d07-b3b3-180797730842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371cccf2-0545-472f-97ef-0c3d24744b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:58 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 (a360bf2e-4b02-4905-8e9a-4e4488246dc3): created successfully Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371cccf2-0545-472f-97ef-0c3d24744b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (cd118d07-5a18-409a-891e-fc2a2d01b912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cabeb3d1-20db-40a9-8bd3-9e354dd5258c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created volume successfully. Jul 06 12:22:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 1073741824" returned: 0 in 1.222s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:59 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:59 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 Jul 06 12:22:59 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:00 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865" returned: 0 in 0.975s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.030s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1940139595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3526077b-3f4d-4562-b773-b60fbeb69bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24adb21695dd40479f16d46cbd26cb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:53Z,use_quota=True,user_id='4fdc8bac6f0845c0b379ab5ab2a2fdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Creating volume 3526077b-3f4d-4562-b773-b60fbeb69bd4 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:00 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:00 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 1073741824 Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e2c3db-c3b4-433e-ae38-05c61b033d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79476dc0-1efd-4d0a-942d-7215c8e1d865', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b36d4b6-cd63-45ec-bc21-fe396302d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:00 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 (79476dc0-1efd-4d0a-942d-7215c8e1d865): created successfully Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b36d4b6-cd63-45ec-bc21-fe396302d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (da16348e-d4fc-4728-97a9-441de3d732e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b50f20a3-513e-40c1-83ab-8767ca3676c8 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created volume successfully. Jul 06 12:23:01 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 1073741824" returned: 0 in 1.070s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:01 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 Jul 06 12:23:01 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:02 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4" returned: 0 in 0.966s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddef725-94e8-449a-a0e6-b4ed977441ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3526077b-3f4d-4562-b773-b60fbeb69bd4', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa185e6d-6cf1-4cb2-81af-ce735d5863e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:02 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Volume volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 (3526077b-3f4d-4562-b773-b60fbeb69bd4): created successfully Jul 06 12:23:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa185e6d-6cf1-4cb2-81af-ce735d5863e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Flow 'volume_create_manager' (b40aefe3-a077-421e-aca0-06972f9bf970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ee3e22d8-23ce-447e-8155-e01fb3e0f81f tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created volume successfully. Jul 06 12:23:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-3526077b-3f4d-4562-b773-b60fbeb69bd4-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-3526077b-3f4d-4562-b773-b60fbeb69bd4-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-3526077b-3f4d-4562-b773-b60fbeb69bd4" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-3526077b-3f4d-4562-b773-b60fbeb69bd4" acquired by "delete_volume" :: waited 0.065s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d719858b-2642-451a-b1aa-b56f4696e291]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:03 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 Jul 06 12:23:03 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:04 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4" returned: 0 in 0.951s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:04 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4 Jul 06 12:23:04 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:05 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3526077b-3f4d-4562-b773-b60fbeb69bd4" returned: 0 in 0.965s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-3526077b-3f4d-4562-b773-b60fbeb69bd4" released by "delete_volume" :: held 2.004s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created reservations ['65e27481-263a-495a-a580-9190fd47314b', 'ed3d9aea-8c10-4f14-8129-a2dcf81bceb1', '666e4d4a-f3ed-4c32-9f44-0c6bdc0eb596', '0f91b685-86f3-464e-9603-573d0377754f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:06 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:06 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:06 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.788s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Deleted volume successfully. Jul 06 12:23:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e5e8017-7ec4-414f-8fac-a23bb43c37d4 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-3526077b-3f4d-4562-b773-b60fbeb69bd4-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-79476dc0-1efd-4d0a-942d-7215c8e1d865-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-79476dc0-1efd-4d0a-942d-7215c8e1d865-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-79476dc0-1efd-4d0a-942d-7215c8e1d865" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-79476dc0-1efd-4d0a-942d-7215c8e1d865" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[613fe38e-c893-4e70-a4df-7858295f24e3]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:07 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 Jul 06 12:23:07 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:08 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865" returned: 0 in 1.066s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:08 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865 Jul 06 12:23:08 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:09 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79476dc0-1efd-4d0a-942d-7215c8e1d865" returned: 0 in 1.108s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-79476dc0-1efd-4d0a-942d-7215c8e1d865" released by "delete_volume" :: held 2.257s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created reservations ['5da81cd0-bcba-4f69-b666-4a6154630127', '3e7332f5-d725-495a-ae9c-24459964f330', 'f846b021-1ac5-4d90-b1f3-88c0b60cb65f', '2521fa8b-8c56-4e45-96d7-fe57d2c34d45'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:09 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:09 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-a360bf2e-4b02-4905-8e9a-4e4488246dc3-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-a360bf2e-4b02-4905-8e9a-4e4488246dc3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-a360bf2e-4b02-4905-8e9a-4e4488246dc3" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-a360bf2e-4b02-4905-8e9a-4e4488246dc3" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e815559e-bd33-40d0-9d73-61831f8a820f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:10 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.071s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:10 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Deleted volume successfully. Jul 06 12:23:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0ca24820-070a-4faa-b932-aead2168c49b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-79476dc0-1efd-4d0a-942d-7215c8e1d865-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:11 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 Jul 06 12:23:11 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:12 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3" returned: 0 in 1.202s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:12 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3 Jul 06 12:23:12 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:12 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a360bf2e-4b02-4905-8e9a-4e4488246dc3" returned: 0 in 0.914s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-a360bf2e-4b02-4905-8e9a-4e4488246dc3" released by "delete_volume" :: held 2.189s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created reservations ['bf9b549f-f51f-4b29-8d4b-df4b66b6b2b7', 'a6468732-efca-4afd-a492-c0d37d0bfaa0', 'e49e2a95-f287-42fe-84d1-80f603b86166', 'c8ae29af-4b0e-4328-9d53-cf65d856ebd8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:13 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:13 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:14 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-69918e82-23da-491b-8c61-9608efcd6568-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.181s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Deleted volume successfully. Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-69918e82-23da-491b-8c61-9608efcd6568-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b9b5af1e-fa3a-428b-8366-df7c07f8e4aa tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-a360bf2e-4b02-4905-8e9a-4e4488246dc3-delete_volume" released by "delete_volume" :: held 3.818s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-69918e82-23da-491b-8c61-9608efcd6568" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-69918e82-23da-491b-8c61-9608efcd6568" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a7b166-5d13-49e0-ac39-1bb9bd43a162]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:14 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 Jul 06 12:23:14 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:15 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568" returned: 0 in 1.166s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:15 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568 Jul 06 12:23:15 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:16 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69918e82-23da-491b-8c61-9608efcd6568" returned: 0 in 0.873s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-69918e82-23da-491b-8c61-9608efcd6568" released by "delete_volume" :: held 2.101s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created reservations ['7b453ec7-2884-4f7d-8abb-010eeed0ce87', 'ae7593d0-196c-4af9-aab9-3b4c61a06eb9', 'ea9fc518-ef40-4c79-acfe-2b7166ada69c', 'cf67cd92-4b57-42d6-9399-05d82f73f9ce'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:16 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:16 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:17 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.802s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Deleted volume successfully. Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98f2c558-7867-4f18-91fc-96c1a882434c tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-69918e82-23da-491b-8c61-9608efcd6568-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-609d41d7-0420-427a-b2b6-7a201f76b08f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-609d41d7-0420-427a-b2b6-7a201f76b08f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-609d41d7-0420-427a-b2b6-7a201f76b08f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-609d41d7-0420-427a-b2b6-7a201f76b08f" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[044a2f39-091d-49f6-963b-ff1ca9dd3ab3]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:18 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f Jul 06 12:23:18 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:19 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f" returned: 0 in 1.095s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:19 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f Jul 06 12:23:19 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:19 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-609d41d7-0420-427a-b2b6-7a201f76b08f" returned: 0 in 0.849s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-609d41d7-0420-427a-b2b6-7a201f76b08f" released by "delete_volume" :: held 2.000s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created reservations ['916eb019-5acc-423c-855f-a6fadb275868', '021a157a-e544-48b1-8e43-0ace5f437733', '8e0c38bf-b449-49b0-b3c5-ff4ddb7572e7', 'f239c81c-5580-4cdc-85e0-3cd6c018cc4d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:20 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:20 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-8a3c532c-daa7-490e-a798-6feff31f7bda-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-8a3c532c-daa7-490e-a798-6feff31f7bda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-8980d1fe-397f-4423-8e03-e3a896ffcf90" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-8980d1fe-397f-4423-8e03-e3a896ffcf90" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-8a3c532c-daa7-490e-a798-6feff31f7bda" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-8a3c532c-daa7-490e-a798-6feff31f7bda" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Deleting offline snapshot 8a3c532c-daa7-490e-a798-6feff31f7bda of volume 8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] snapshot_file for this snap is: volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2af4f7-01c7-4499-adeb-ebccfbf655c1]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:20 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda Jul 06 12:23:20 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:20 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.825s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Deleted volume successfully. Jul 06 12:23:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fea3a32-53cd-4faa-9312-86068e8ac71b tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-609d41d7-0420-427a-b2b6-7a201f76b08f-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:21 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda" returned: 0 in 0.945s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:21 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8980d1fe-397f-4423-8e03-e3a896ffcf90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:21 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[82607c17-6caf-4c01-bf93-a884224b2756]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:21 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 Jul 06 12:23:21 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:22 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90" returned: 0 in 1.015s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:22 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda Jul 06 12:23:22 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:23 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda" returned: 0 in 1.092s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:23 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda Jul 06 12:23:23 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:24 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90.8a3c532c-daa7-490e-a798-6feff31f7bda" returned: 0 in 1.028s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-8a3c532c-daa7-490e-a798-6feff31f7bda" released by "_delete_snapshot" :: held 4.242s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-8980d1fe-397f-4423-8e03-e3a896ffcf90" released by "delete_snapshot" :: held 4.298s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:24 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created reservations ['71ce7c80-0e6b-4a11-8a3a-7b3d8440307f', 'bdef4638-a98a-4db4-8d30-b05d6339ccac', '5176e38d-44f5-420b-b9c3-b8273d2dc97c', '001f806b-5167-46ab-af5c-6decedc52f2d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:24 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Delete snapshot completed successfully. Jul 06 12:23:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b03dc8fa-1212-498b-84a2-56b9daf169b2 tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-8a3c532c-daa7-490e-a798-6feff31f7bda-delete_snapshot" released by "delete_snapshot" :: held 4.541s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-8980d1fe-397f-4423-8e03-e3a896ffcf90-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-8980d1fe-397f-4423-8e03-e3a896ffcf90-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "cinder-quobyte-8980d1fe-397f-4423-8e03-e3a896ffcf90" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-8980d1fe-397f-4423-8e03-e3a896ffcf90" acquired by "delete_volume" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:25 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f134f3-501e-4b60-8fae-adcd64425e3c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:25 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 Jul 06 12:23:25 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:26 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90" returned: 0 in 0.995s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:26 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90 Jul 06 12:23:26 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:27 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:27 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:27 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8980d1fe-397f-4423-8e03-e3a896ffcf90" returned: 0 in 1.069s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-quobyte-8980d1fe-397f-4423-8e03-e3a896ffcf90" released by "delete_volume" :: held 2.137s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:27 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Created reservations ['6fbfa6f0-cd8b-4b7d-a08b-987ec2a67687', 'e9f76c09-96c6-4a71-822e-aef9c702632a', '1f2e5d6a-8924-4d4f-8446-2b04cb720bbc', '8f680008-dad3-4264-8f4f-968b61b515f6'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:28 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.956s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:28 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:28 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Flow 'volume_create_manager' (96297d8a-cfd7-44c1-8565-a99cca11b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f0e7c2-fc46-49b9-ada0-f024f7b53f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f0e7c2-fc46-49b9-ada0-f024f7b53f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-139734223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b48aa1fb9a34873ac74cd87d4d47978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:28Z,use_quota=True,user_id='797646c078bf4058a20862fa31dcf5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acf4ea8-6231-4c6a-8f1f-301416b85b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acf4ea8-6231-4c6a-8f1f-301416b85b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc7d181-4da4-4e7f-b4a9-9907b16d036f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc7d181-4da4-4e7f-b4a9-9907b16d036f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8', 'volume_name': 'volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740819f2-f923-4d2e-ab70-ec963576a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740819f2-f923-4d2e-ab70-ec963576a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eab800-387d-44aa-9cd2-31c7db977f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:28 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Volume a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8', 'volume_size': 1} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-139734223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b48aa1fb9a34873ac74cd87d4d47978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:28Z,use_quota=True,user_id='797646c078bf4058a20862fa31dcf5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Creating volume a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:28 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:23:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:28 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 1073741824 Jul 06 12:23:28 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Flow 'volume_create_manager' (19730450-336a-423f-97f4-1fd5417dec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07309d39-6188-4f99-8222-7ba34acc4bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07309d39-6188-4f99-8222-7ba34acc4bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2115928060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9813ba4c-34ff-414a-9f01-df437457f2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b48aa1fb9a34873ac74cd87d4d47978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:29Z,use_quota=True,user_id='797646c078bf4058a20862fa31dcf5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007f019f-cd41-45f4-9c24-5c9babd09a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007f019f-cd41-45f4-9c24-5c9babd09a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8e4dc0-e668-4474-9052-3cec261d1796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8e4dc0-e668-4474-9052-3cec261d1796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9813ba4c-34ff-414a-9f01-df437457f2fb', 'volume_name': 'volume-9813ba4c-34ff-414a-9f01-df437457f2fb', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8afd4d0-e42f-4304-93dd-ce8e61192943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8afd4d0-e42f-4304-93dd-ce8e61192943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c8c555-efa1-400f-aef7-6a99d2a8aa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Volume 9813ba4c-34ff-414a-9f01-df437457f2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9813ba4c-34ff-414a-9f01-df437457f2fb', 'volume_size': 1} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.129s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:29 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Deleted volume successfully. Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5eabfdbf-3bb1-44d4-82f3-1dd4134b192e tempest-CreateVolumesFromSnapshotTest-1501890922 None] Lock "cinder-8980d1fe-397f-4423-8e03-e3a896ffcf90-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Flow 'volume_create_manager' (6f9c870f-f244-451e-825d-22628211ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b012792-1db1-4c84-8906-c0dafb112fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b012792-1db1-4c84-8906-c0dafb112fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-297008092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b875a51-0f93-4be7-8e66-7c4c1f4704ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa22c24fab44e21812494cf5c121dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:30Z,use_quota=True,user_id='d992e013a7f842d891dd72217f99cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47781573-6232-49d8-9c65-0e4cd02d624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47781573-6232-49d8-9c65-0e4cd02d624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93bd8f0-e8c5-4478-8147-c3753b5c7647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93bd8f0-e8c5-4478-8147-c3753b5c7647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b875a51-0f93-4be7-8e66-7c4c1f4704ce', 'volume_name': 'volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7511def2-50d8-463a-a73d-0e782d4777c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7511def2-50d8-463a-a73d-0e782d4777c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71c7858-741c-4479-ab41-411c219c7aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:29 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Volume 7b875a51-0f93-4be7-8e66-7c4c1f4704ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce', 'volume_size': 1} Jul 06 12:23:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:30 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 1073741824" returned: 0 in 1.608s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:30 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 Jul 06 12:23:30 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8" returned: 0 in 0.902s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] <== create_volume: return (2575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.577s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2115928060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9813ba4c-34ff-414a-9f01-df437457f2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b48aa1fb9a34873ac74cd87d4d47978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:29Z,use_quota=True,user_id='797646c078bf4058a20862fa31dcf5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Creating volume 9813ba4c-34ff-414a-9f01-df437457f2fb {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:31 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:31 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb 1073741824 Jul 06 12:23:31 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eab800-387d-44aa-9cd2-31c7db977f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccac74e-7d88-47b9-8744-ea1f405082ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Volume volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 (a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8): created successfully Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccac74e-7d88-47b9-8744-ea1f405082ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Flow 'volume_create_manager' (96297d8a-cfd7-44c1-8565-a99cca11b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:31 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e8824f24-a0d3-4791-bde9-09255ca36940 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Created volume successfully. Jul 06 12:23:32 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb 1073741824" returned: 0 in 1.220s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:32 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb Jul 06 12:23:32 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:33 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb" returned: 0 in 0.824s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.423s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-297008092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b875a51-0f93-4be7-8e66-7c4c1f4704ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa22c24fab44e21812494cf5c121dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:30Z,use_quota=True,user_id='d992e013a7f842d891dd72217f99cbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Creating volume 7b875a51-0f93-4be7-8e66-7c4c1f4704ce {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:33 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:33 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce 1073741824 Jul 06 12:23:33 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c8c555-efa1-400f-aef7-6a99d2a8aa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9813ba4c-34ff-414a-9f01-df437457f2fb', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b6c1c1-3173-43a6-874f-4f4013b845a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Volume volume-9813ba4c-34ff-414a-9f01-df437457f2fb (9813ba4c-34ff-414a-9f01-df437457f2fb): created successfully Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b6c1c1-3173-43a6-874f-4f4013b845a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Flow 'volume_create_manager' (19730450-336a-423f-97f4-1fd5417dec7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-80ccd49c-2bfe-4262-beb6-13ab59fbbcb9 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Created volume successfully. Jul 06 12:23:34 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce 1073741824" returned: 0 in 1.228s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:34 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce Jul 06 12:23:34 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:35 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce" returned: 0 in 0.766s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71c7858-741c-4479-ab41-411c219c7aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d58bdd-6e2d-4e07-9dc5-8a05fe19bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:35 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Volume volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce (7b875a51-0f93-4be7-8e66-7c4c1f4704ce): created successfully Jul 06 12:23:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d58bdd-6e2d-4e07-9dc5-8a05fe19bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Flow 'volume_create_manager' (6f9c870f-f244-451e-825d-22628211ed06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:35 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-843b8cfe-2c1e-42da-914b-da5b79922dd9 tempest-AttachVolumeNegativeTest-1715433974 None] Created volume successfully. Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Flow 'volume_create_manager' (55cb5762-53c5-4cdb-b397-8521e4c54847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea69724-3214-4d3f-9b1c-9c7edaf39506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea69724-3214-4d3f-9b1c-9c7edaf39506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9537cac4f4f7472e9a26219ff79f4611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:37Z,use_quota=True,user_id='42269b0f078f4d45898df8ab2d7d3136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9365e9cc-535d-4dec-99c6-9af26795f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9365e9cc-535d-4dec-99c6-9af26795f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d63f1e-1bb9-407e-8517-34eaa8b55ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:23:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d63f1e-1bb9-407e-8517-34eaa8b55ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3', 'volume_name': 'volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3', 'volume_size': 1, 'image_id': '363d7e88-db4d-406d-be43-014bc7d04370', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/363d7e88-db4d-406d-be43-014bc7d04370', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f8f3e43808d01033d124052fe6f0eb5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9537cac4f4f7472e9a26219ff79f4611', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33cb2700c62f54a5ce9d84932a88af49664ce0ac246c4ae631477c8818fd4945c4ff2e9a750f8846c156a4b5f2c36934a211b498f1ef6158571ffb9aa16edfae', 'id': '363d7e88-db4d-406d-be43-014bc7d04370', 'created_at': datetime.datetime(2026, 7, 6, 10, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/363d7e88-db4d-406d-be43-014bc7d04370/file', 'properties': {}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c7e3ad-4f1f-41af-8d16-ad6c565268e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c7e3ad-4f1f-41af-8d16-ad6c565268e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36570e42-f18c-4b44-8fda-ce438153a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:37 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Volume 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3', 'volume_size': 1, 'image_id': '363d7e88-db4d-406d-be43-014bc7d04370', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/363d7e88-db4d-406d-be43-014bc7d04370', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f8f3e43808d01033d124052fe6f0eb5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9537cac4f4f7472e9a26219ff79f4611', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33cb2700c62f54a5ce9d84932a88af49664ce0ac246c4ae631477c8818fd4945c4ff2e9a750f8846c156a4b5f2c36934a211b498f1ef6158571ffb9aa16edfae', 'id': '363d7e88-db4d-406d-be43-014bc7d04370', 'created_at': datetime.datetime(2026, 7, 6, 10, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/363d7e88-db4d-406d-be43-014bc7d04370/file', 'properties': {}}, 'image_service': } Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Trying to clone 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 from image 363d7e88-db4d-406d-be43-014bc7d04370 at location (None, [{'url': 'file:///opt/stack/data/glance/images/363d7e88-db4d-406d-be43-014bc7d04370', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:23:37 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a58df7-718c-4c34-ac78-de5b2ff0194c]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:37 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD Jul 06 12:23:37 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:37 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:38 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD Jul 06 12:23:38 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:38 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD" returned: 1 in 0.919s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:38 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Temporary image 363d7e88-db4d-406d-be43-014bc7d04370 is fetched for user 42269b0f078f4d45898df8ab2d7d3136. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:23:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2604a333-f05e-4731-ad94-d9f1fade148b]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:39 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD Jul 06 12:23:39 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-53904531-a884-4450-881f-848eec01ecdf req-ce117739-cdf2-4c4a-a50d-1230e8121412 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-53904531-a884-4450-881f-848eec01ecdf req-ce117739-cdf2-4c4a-a50d-1230e8121412 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9284f80a-2e04-46e1-9e56-9013220d5ab7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-53904531-a884-4450-881f-848eec01ecdf req-ce117739-cdf2-4c4a-a50d-1230e8121412 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:39 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce Jul 06 12:23:39 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:40 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD" returned: 0 in 1.089s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:40 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD Jul 06 12:23:40 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:40 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-53904531-a884-4450-881f-848eec01ecdf req-ce117739-cdf2-4c4a-a50d-1230e8121412 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce" returned: 0 in 1.056s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-53904531-a884-4450-881f-848eec01ecdf req-ce117739-cdf2-4c4a-a50d-1230e8121412 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-53904531-a884-4450-881f-848eec01ecdf req-ce117739-cdf2-4c4a-a50d-1230e8121412 tempest-AttachVolumeNegativeTest-1715433974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a580deef-2053-4c1b-ae59-2fa6a53aebfd', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:23:40 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-53904531-a884-4450-881f-848eec01ecdf req-ce117739-cdf2-4c4a-a50d-1230e8121412 tempest-AttachVolumeNegativeTest-1715433974 None] attachment_update completed successfully. Jul 06 12:23:41 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD" returned: 1 in 1.047s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9537cac4f4f7472e9a26219ff79f4611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:37Z,use_quota=True,user_id='42269b0f078f4d45898df8ab2d7d3136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Creating volume 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:41 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:23:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:41 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 1073741824 Jul 06 12:23:41 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:42 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 1073741824" returned: 0 in 1.073s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:42 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 Jul 06 12:23:42 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:42 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" returned: 0 in 0.675s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:42 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Attempting download of 363d7e88-db4d-406d-be43-014bc7d04370 ((None, [{'url': 'file:///opt/stack/data/glance/images/363d7e88-db4d-406d-be43-014bc7d04370', 'metadata': {}}])) to volume 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:23:43 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24378e-42b0-4ccf-8c7f-f3277fb14292]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_363d7e88-db4d-406d-be43-014bc7d04370_u3wqul8a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:43 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_363d7e88-db4d-406d-be43-014bc7d04370_u3wqul8a Jul 06 12:23:43 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:43 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_363d7e88-db4d-406d-be43-014bc7d04370_u3wqul8a" returned: 0 in 0.765s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_363d7e88-db4d-406d-be43-014bc7d04370_u3wqul8a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:43 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_363d7e88-db4d-406d-be43-014bc7d04370_u3wqul8a Jul 06 12:23:43 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:44 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_363d7e88-db4d-406d-be43-014bc7d04370_u3wqul8a" returned: 1 in 0.966s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_363d7e88-db4d-406d-be43-014bc7d04370_u3wqul8a' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6bb560-f08c-4d63-8f9e-b41f5f7b3d00]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:44 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD Jul 06 12:23:44 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD" returned: 0 in 1.361s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:46 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:46 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD Jul 06 12:23:46 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:46 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD" returned: 1 in 0.833s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:46 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] 363d7e88-db4d-406d-be43-014bc7d04370 was raw, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:23:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:47 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 Jul 06 12:23:47 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:47 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-f677cfea-2f35-472a-abc4-887fb1405766 req-f70ed56d-ed15-4b42-91ee-3793768103fb tempest-AttachVolumeNegativeTest-1715433974 None] Terminate volume connection completed successfully. Jul 06 12:23:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-f677cfea-2f35-472a-abc4-887fb1405766 req-f70ed56d-ed15-4b42-91ee-3793768103fb tempest-AttachVolumeNegativeTest-1715433974 None] Deleting attachment a580deef-2053-4c1b-ae59-2fa6a53aebfd. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:23:47 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" returned: 0 in 0.961s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:47 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_363d7e88-db4d-406d-be43-014bc7d04370_fqqc9w9ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:23:47 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:23:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:47 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 1G Jul 06 12:23:47 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:48 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 1G" returned: 0 in 0.896s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3608e31-5570-4088-aea8-b27f4424e897]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:49 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 Jul 06 12:23:49 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:50 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" returned: 0 in 1.353s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:50 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 Jul 06 12:23:50 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:51 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" returned: 1 in 1.474s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Downloaded image 363d7e88-db4d-406d-be43-014bc7d04370 ((None, [{'url': 'file:///opt/stack/data/glance/images/363d7e88-db4d-406d-be43-014bc7d04370', 'metadata': {}}])) to volume 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Temporary image 363d7e88-db4d-406d-be43-014bc7d04370 for user 42269b0f078f4d45898df8ab2d7d3136 is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Marking volume 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Copying metadata from image 363d7e88-db4d-406d-be43-014bc7d04370 to 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Creating volume glance metadata for volume 8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 backed by image 363d7e88-db4d-406d-be43-014bc7d04370 with: {'image_id': '363d7e88-db4d-406d-be43-014bc7d04370', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3f8f3e43808d01033d124052fe6f0eb5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36570e42-f18c-4b44-8fda-ce438153a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3', 'volume_size': 1, 'image_id': '363d7e88-db4d-406d-be43-014bc7d04370', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/363d7e88-db4d-406d-be43-014bc7d04370', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f8f3e43808d01033d124052fe6f0eb5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9537cac4f4f7472e9a26219ff79f4611', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33cb2700c62f54a5ce9d84932a88af49664ce0ac246c4ae631477c8818fd4945c4ff2e9a750f8846c156a4b5f2c36934a211b498f1ef6158571ffb9aa16edfae', 'id': '363d7e88-db4d-406d-be43-014bc7d04370', 'created_at': datetime.datetime(2026, 7, 6, 10, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/363d7e88-db4d-406d-be43-014bc7d04370/file', 'properties': {}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bee873-ba05-4d89-a24f-3fe0626688c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Volume volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 (8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3): created successfully Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bee873-ba05-4d89-a24f-3fe0626688c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Flow 'volume_create_manager' (55cb5762-53c5-4cdb-b397-8521e4c54847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f16d28b5-a6fe-4929-8d2a-d9c1bd680c35 tempest-VolumeImageDependencyTests-1472710166 None] Created volume successfully. Jul 06 12:23:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Acquiring lock "cinder-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Lock "cinder-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Acquiring lock "cinder-quobyte-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Lock "cinder-quobyte-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:53 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e65686-dffa-4992-9bfb-2d21eecd78a3]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:53 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 Jul 06 12:23:53 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:54 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" returned: 0 in 1.218s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:54 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 Jul 06 12:23:54 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:55 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" returned: 1 in 0.812s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:23:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:55 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3 Jul 06 12:23:55 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:56 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" returned: 0 in 0.685s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Lock "cinder-quobyte-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3" released by "delete_volume" :: held 2.831s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Created reservations ['bc3cd3da-e286-4e77-9e1e-92a6f39eb6a7', 'e25da994-6cbf-4043-bce7-e102d0baa285', '96819c1d-f92c-47d3-a5d7-4d859e102708', 'a81b5234-8ada-4127-b6ae-652b7274db45'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:56 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:23:56 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:57 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.841s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:57 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Deleted volume successfully. Jul 06 12:23:57 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=63,cinder:INSERT=27,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:23:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2176cf8b-a907-4196-91c3-d237bc7029a1 tempest-VolumeImageDependencyTests-1472710166 None] Lock "cinder-8477bcd5-2ca0-486f-8ef6-f7ec3c8913e3-delete_volume" released by "delete_volume" :: held 4.084s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "cinder-7b875a51-0f93-4be7-8e66-7c4c1f4704ce-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-7b875a51-0f93-4be7-8e66-7c4c1f4704ce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:00 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=87,cinder:SELECT=65,cinder:DELETE=8,cinder:INSERT=21 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:24:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "cinder-quobyte-7b875a51-0f93-4be7-8e66-7c4c1f4704ce" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-quobyte-7b875a51-0f93-4be7-8e66-7c4c1f4704ce" acquired by "delete_volume" :: waited 0.058s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0080dfd-b5c2-42b7-9a38-ff1f0217f7c2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:00 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce Jul 06 12:24:00 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:01 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce" returned: 0 in 1.197s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:01 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce Jul 06 12:24:01 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Flow 'volume_create_manager' (a84b50a5-9835-430f-a721-195411a24c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45eaf89-5530-49ac-ab2e-2fc50e5505c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45eaf89-5530-49ac-ab2e-2fc50e5505c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1299338696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305c186f-bcbc-475c-a045-d3636f84f9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995ed2ac0b42456bb197e6729a449080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:02Z,use_quota=True,user_id='218766abd6b844a2823f0c31eb5a80ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc36cfc1-fb75-415a-ae59-4c24b041aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc36cfc1-fb75-415a-ae59-4c24b041aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132f5728-5aab-4a24-a2cc-d568127d07f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132f5728-5aab-4a24-a2cc-d568127d07f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305c186f-bcbc-475c-a045-d3636f84f9f3', 'volume_name': 'volume-305c186f-bcbc-475c-a045-d3636f84f9f3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47361d8-a33e-4a97-a787-1977c6e70ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47361d8-a33e-4a97-a787-1977c6e70ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00812a7f-eabd-4170-a166-eedf140727cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:02 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Volume 305c186f-bcbc-475c-a045-d3636f84f9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305c186f-bcbc-475c-a045-d3636f84f9f3', 'volume_size': 1} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1299338696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305c186f-bcbc-475c-a045-d3636f84f9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995ed2ac0b42456bb197e6729a449080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:02Z,use_quota=True,user_id='218766abd6b844a2823f0c31eb5a80ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Creating volume 305c186f-bcbc-475c-a045-d3636f84f9f3 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:02 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:02 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 1073741824 Jul 06 12:24:02 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:02 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7b875a51-0f93-4be7-8e66-7c4c1f4704ce" returned: 0 in 0.963s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-quobyte-7b875a51-0f93-4be7-8e66-7c4c1f4704ce" released by "delete_volume" :: held 2.224s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Created reservations ['5b8403cb-58e0-48e0-b74c-67236232b8b7', '17920077-2e37-4bb3-b89a-ec5edb5d5088', '12c807ec-bc97-4650-9d63-7018338921c2', 'ab0656ee-4c94-469f-9526-96bc012a3a96'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:02 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:02 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:03 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 1073741824" returned: 0 in 1.038s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:03 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 Jul 06 12:24:03 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:03 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.789s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:03 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Deleted volume successfully. Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-86ca5087-b019-44e6-a7a6-b38621afdaa3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-7b875a51-0f93-4be7-8e66-7c4c1f4704ce-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "cinder-5ccd9a28-fe6c-433b-b3e1-008a71b8e787-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-5ccd9a28-fe6c-433b-b3e1-008a71b8e787-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "cinder-quobyte-5ccd9a28-fe6c-433b-b3e1-008a71b8e787" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-quobyte-5ccd9a28-fe6c-433b-b3e1-008a71b8e787" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7459a5-1c7d-4bf8-8e5a-8997c08d5953]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:04 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 Jul 06 12:24:04 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:04 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3" returned: 0 in 0.762s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00812a7f-eabd-4170-a166-eedf140727cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305c186f-bcbc-475c-a045-d3636f84f9f3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e53d7ed-0420-4ad8-981b-6a219e705150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Volume volume-305c186f-bcbc-475c-a045-d3636f84f9f3 (305c186f-bcbc-475c-a045-d3636f84f9f3): created successfully Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e53d7ed-0420-4ad8-981b-6a219e705150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Flow 'volume_create_manager' (a84b50a5-9835-430f-a721-195411a24c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:04 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-25311a53-a472-47ad-b042-7c6954168fe3 tempest-ProjectReaderTests-202607225 None] Created volume successfully. Jul 06 12:24:04 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787" returned: 0 in 0.840s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:04 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787 Jul 06 12:24:04 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:05 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5ccd9a28-fe6c-433b-b3e1-008a71b8e787" returned: 0 in 0.705s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Acquiring lock "cinder-305c186f-bcbc-475c-a045-d3636f84f9f3-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-quobyte-5ccd9a28-fe6c-433b-b3e1-008a71b8e787" released by "delete_volume" :: held 1.609s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Lock "cinder-305c186f-bcbc-475c-a045-d3636f84f9f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Acquiring lock "cinder-quobyte-305c186f-bcbc-475c-a045-d3636f84f9f3" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Lock "cinder-quobyte-305c186f-bcbc-475c-a045-d3636f84f9f3" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Created reservations ['a993c801-7998-4da9-a715-7f92151a9093', 'cbd957cd-0656-4c8c-bd1e-961f12e0e743', 'a1e99608-e2bf-4cb8-af8f-ede8bad9952b', 'dc4aff20-9cb5-4a79-9e89-8f5cbfd61dfb'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5353667-9536-4497-9b35-87b9b9b06b6e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:05 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:05 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 Jul 06 12:24:05 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:05 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "cinder-9846c8eb-a845-44dd-b4e5-0698dcadcc52-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-9846c8eb-a845-44dd-b4e5-0698dcadcc52-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:06 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.724s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Deleted volume successfully. Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "cinder-quobyte-9846c8eb-a845-44dd-b4e5-0698dcadcc52" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-73b367a1-bfa9-45ee-95a6-d935e61443a3 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-5ccd9a28-fe6c-433b-b3e1-008a71b8e787-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-quobyte-9846c8eb-a845-44dd-b4e5-0698dcadcc52" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374c203-3894-4fa1-877b-8e49fac8b29d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:06 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3" returned: 0 in 0.997s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:06 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3 Jul 06 12:24:06 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:06 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 Jul 06 12:24:06 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:07 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-305c186f-bcbc-475c-a045-d3636f84f9f3" returned: 0 in 0.765s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:07 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52" returned: 0 in 0.874s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Lock "cinder-quobyte-305c186f-bcbc-475c-a045-d3636f84f9f3" released by "delete_volume" :: held 1.823s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:07 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52 Jul 06 12:24:07 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Created reservations ['cc5f5e4c-ac6b-45a3-9d3c-1797bf2e2bee', '5e9732ab-c56d-43af-a019-172792ff5317', '86aad8bf-3359-4fda-8773-326b3c5d6c5f', '29fefc45-41a7-49e2-bf07-8b87c274613d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:07 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:07 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:08 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9846c8eb-a845-44dd-b4e5-0698dcadcc52" returned: 0 in 0.852s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-quobyte-9846c8eb-a845-44dd-b4e5-0698dcadcc52" released by "delete_volume" :: held 1.784s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Created reservations ['5adca341-f040-49be-8bc1-316b612d0aa2', '05954cc3-7642-4f9c-9dd6-8fd842a07220', 'c66daaaf-6f20-43a2-88a8-6f231147e745', '9d3704fd-f774-4dc8-88ec-c6d459d28c84'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Flow 'volume_create_manager' (b2609aa6-5d53-4997-99c6-b6e1bbe95c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ee1840-43c5-463c-bda2-c82f3922a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ee1840-43c5-463c-bda2-c82f3922a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629789763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a0f8c7-84da-4535-bfde-43cdb4111849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995ed2ac0b42456bb197e6729a449080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:08Z,use_quota=True,user_id='218766abd6b844a2823f0c31eb5a80ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01336fa1-6c28-4129-b7a6-48f8da456c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:08 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01336fa1-6c28-4129-b7a6-48f8da456c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d844a07-2925-4877-b4b7-0f6d3515aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d844a07-2925-4877-b4b7-0f6d3515aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a0f8c7-84da-4535-bfde-43cdb4111849', 'volume_name': 'volume-c9a0f8c7-84da-4535-bfde-43cdb4111849', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc72a50-e42c-4e4c-9505-53c6d8e33ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc72a50-e42c-4e4c-9505-53c6d8e33ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036071c7-c116-466a-8994-59398d5b8308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:08 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Volume c9a0f8c7-84da-4535-bfde-43cdb4111849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a0f8c7-84da-4535-bfde-43cdb4111849', 'volume_size': 1} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629789763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a0f8c7-84da-4535-bfde-43cdb4111849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995ed2ac0b42456bb197e6729a449080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:08Z,use_quota=True,user_id='218766abd6b844a2823f0c31eb5a80ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Creating volume c9a0f8c7-84da-4535-bfde-43cdb4111849 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:08 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:08 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 1073741824 Jul 06 12:24:08 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.068s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Deleted volume successfully. Jul 06 12:24:08 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:08 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83e5b077-e3b8-4e7f-a8fb-ea2870074b91 tempest-ProjectReaderTests-202607225 None] Lock "cinder-305c186f-bcbc-475c-a045-d3636f84f9f3-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:09 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.888s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:09 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Deleted volume successfully. Jul 06 12:24:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e7569deb-2e83-4879-99ba-dde316030429 tempest-AttachVolumeNegativeTest-1715433974 None] Lock "cinder-9846c8eb-a845-44dd-b4e5-0698dcadcc52-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:09 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 1073741824" returned: 0 in 1.147s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:09 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 Jul 06 12:24:09 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:10 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849" returned: 0 in 0.814s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036071c7-c116-466a-8994-59398d5b8308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a0f8c7-84da-4535-bfde-43cdb4111849', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25151eee-3fd8-4f6a-9b6f-54227ccd973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:10 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Volume volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 (c9a0f8c7-84da-4535-bfde-43cdb4111849): created successfully Jul 06 12:24:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25151eee-3fd8-4f6a-9b6f-54227ccd973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Flow 'volume_create_manager' (b2609aa6-5d53-4997-99c6-b6e1bbe95c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:10 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-95b7e4a7-a607-4658-96bd-cefc2ae260ac tempest-ProjectReaderTests-202607225 None] Created volume successfully. Jul 06 12:24:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Acquiring lock "cinder-c9a0f8c7-84da-4535-bfde-43cdb4111849-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Lock "cinder-c9a0f8c7-84da-4535-bfde-43cdb4111849-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Acquiring lock "cinder-quobyte-c9a0f8c7-84da-4535-bfde-43cdb4111849" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Lock "cinder-quobyte-c9a0f8c7-84da-4535-bfde-43cdb4111849" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:11 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[163b815c-8ee5-46bc-bf60-a25a3ab0bdf5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:11 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 Jul 06 12:24:11 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:12 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849" returned: 0 in 0.952s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:12 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849 Jul 06 12:24:12 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:13 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9a0f8c7-84da-4535-bfde-43cdb4111849" returned: 0 in 0.844s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Lock "cinder-quobyte-c9a0f8c7-84da-4535-bfde-43cdb4111849" released by "delete_volume" :: held 1.851s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Created reservations ['eb9e680f-0fec-4c24-93d0-eedabefa13a0', 'fcb11a1e-4eaa-4645-a2b8-ad59c5582ba0', 'a6ab854c-eefc-4fb6-badc-71ab5dfba3c9', '42d1a94e-cf92-4390-b092-33ba43b6d3b8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:13 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:13 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:14 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.926s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:14 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Deleted volume successfully. Jul 06 12:24:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3694a958-7f37-4512-8804-a252f577854e tempest-ProjectReaderTests-202607225 None] Lock "cinder-c9a0f8c7-84da-4535-bfde-43cdb4111849-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-b2bf5f13-d463-4dc4-b271-20b9784858d2 req-38bdafa4-c7d1-463b-99e8-fda1ec2009f7 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-b2bf5f13-d463-4dc4-b271-20b9784858d2 req-38bdafa4-c7d1-463b-99e8-fda1ec2009f7 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:15 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dd5fb2-c5b3-460b-b77b-f6b4cb3dae62]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-b2bf5f13-d463-4dc4-b271-20b9784858d2 req-38bdafa4-c7d1-463b-99e8-fda1ec2009f7 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:15 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 Jul 06 12:24:15 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:16 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-b2bf5f13-d463-4dc4-b271-20b9784858d2 req-38bdafa4-c7d1-463b-99e8-fda1ec2009f7 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8" returned: 0 in 1.065s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-b2bf5f13-d463-4dc4-b271-20b9784858d2 req-38bdafa4-c7d1-463b-99e8-fda1ec2009f7 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.088s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-b2bf5f13-d463-4dc4-b271-20b9784858d2 req-38bdafa4-c7d1-463b-99e8-fda1ec2009f7 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a115cc9a-7666-4a40-97c0-161031d7c7b7', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:24:16 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-b2bf5f13-d463-4dc4-b271-20b9784858d2 req-38bdafa4-c7d1-463b-99e8-fda1ec2009f7 tempest-TestServerVolumeAttachmentScenario-1190296167 None] attachment_update completed successfully. Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Flow 'volume_create_manager' (6ca02d14-4ecf-40b6-bdc1-7ac69aa289c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b26274a-5a71-4b84-b0aa-e538c8c87324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b26274a-5a71-4b84-b0aa-e538c8c87324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-279699956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d5c5b0-7ef6-4ab0-a309-8960f975203f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ec74a23597456da6ef20c0d3de4786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:18Z,use_quota=True,user_id='09f477a046314dde9b8903f7abee2698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f9950d-a64e-4ed8-b9a7-194c7a281155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f9950d-a64e-4ed8-b9a7-194c7a281155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0346a233-808f-4c86-af6b-98ecd725996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0346a233-808f-4c86-af6b-98ecd725996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d5c5b0-7ef6-4ab0-a309-8960f975203f', 'volume_name': 'volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3227f2d1-15e5-48cb-baec-8e37250feaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3227f2d1-15e5-48cb-baec-8e37250feaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5bf717e-1105-40a0-977f-34b9fe19d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:18 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Volume 81d5c5b0-7ef6-4ab0-a309-8960f975203f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f', 'volume_size': 1} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-279699956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d5c5b0-7ef6-4ab0-a309-8960f975203f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4ec74a23597456da6ef20c0d3de4786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:18Z,use_quota=True,user_id='09f477a046314dde9b8903f7abee2698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Creating volume 81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:18 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:24:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:18 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f 1073741824 Jul 06 12:24:18 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:19 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f 1073741824" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:19 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f Jul 06 12:24:19 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:20 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f" returned: 0 in 0.677s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5bf717e-1105-40a0-977f-34b9fe19d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18368e8-8fbe-47b0-a0e2-670b35813dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:20 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Volume volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f (81d5c5b0-7ef6-4ab0-a309-8960f975203f): created successfully Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18368e8-8fbe-47b0-a0e2-670b35813dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Flow 'volume_create_manager' (6ca02d14-4ecf-40b6-bdc1-7ac69aa289c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-9393c42f-9554-4838-9d26-9c52eaa5c6b4 req-86d23cf7-b8ca-4abd-a0c1-4cb78e05248f tempest-VolumesSnapshotsTestJSON-1297801118 None] Created volume successfully. Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Creating offline snapshot 299dea46-d799-4c6d-abd9-26e280c3590d of volume 81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db4ce0-8844-4efa-bb3b-ecff35f59c6d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:21 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f Jul 06 12:24:21 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:21 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f" returned: 0 in 0.788s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:21 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d 1G Jul 06 12:24:21 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:22 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d 1G" returned: 0 in 0.951s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:22 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d Jul 06 12:24:22 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:23 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d" returned: 0 in 0.754s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:23 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d is being set with open permissions: ugo+rw Jul 06 12:24:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:23 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d Jul 06 12:24:23 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:24 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:24 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.info Jul 06 12:24:24 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:24 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.info" returned: 0 in 0.708s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:24 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.info is being set with open permissions: ugo+rw Jul 06 12:24:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:24 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.info Jul 06 12:24:24 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:25 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.info" returned: 0 in 0.706s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.745s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-779ef685-65d4-47c9-9a3d-7c08a0844501 req-668187d6-71a5-42a0-b2e3-0f612b44fcb0 tempest-VolumesSnapshotsTestJSON-1297801118 None] Create snapshot completed successfully Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "cinder-299dea46-d799-4c6d-abd9-26e280c3590d-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-299dea46-d799-4c6d-abd9-26e280c3590d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "cinder-quobyte-81d5c5b0-7ef6-4ab0-a309-8960f975203f" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-quobyte-81d5c5b0-7ef6-4ab0-a309-8960f975203f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "cinder-quobyte-299dea46-d799-4c6d-abd9-26e280c3590d" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-quobyte-299dea46-d799-4c6d-abd9-26e280c3590d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Deleting offline snapshot 299dea46-d799-4c6d-abd9-26e280c3590d of volume 81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] snapshot_file for this snap is: volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ceb85b-f10d-4f20-b21a-4d5f81cea9d7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:26 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d Jul 06 12:24:26 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:27 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:27 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-2c14dcab-8b85-425a-a688-fdb7bd481efb req-8cacf003-ec99-4b59-9120-59e76064a07e tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-2c14dcab-8b85-425a-a688-fdb7bd481efb req-8cacf003-ec99-4b59-9120-59e76064a07e tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d625960-2ec2-40cb-8e18-e79e2c9ad9c8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-2c14dcab-8b85-425a-a688-fdb7bd481efb req-8cacf003-ec99-4b59-9120-59e76064a07e tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:27 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb Jul 06 12:24:27 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:27 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d" returned: 0 in 0.865s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6dea97-fd06-4448-a4de-6ba09491b35e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:27 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.776s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:24:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:24:27 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f Jul 06 12:24:27 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:28 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-2c14dcab-8b85-425a-a688-fdb7bd481efb req-8cacf003-ec99-4b59-9120-59e76064a07e tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb" returned: 0 in 0.863s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-2c14dcab-8b85-425a-a688-fdb7bd481efb req-8cacf003-ec99-4b59-9120-59e76064a07e tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.882s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-2c14dcab-8b85-425a-a688-fdb7bd481efb req-8cacf003-ec99-4b59-9120-59e76064a07e tempest-TestServerVolumeAttachmentScenario-1190296167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-9813ba4c-34ff-414a-9f01-df437457f2fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '901904c3-dcc4-4381-8f2e-8aa8f8973911', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:24:28 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-2c14dcab-8b85-425a-a688-fdb7bd481efb req-8cacf003-ec99-4b59-9120-59e76064a07e tempest-TestServerVolumeAttachmentScenario-1190296167 None] attachment_update completed successfully. Jul 06 12:24:28 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f" returned: 0 in 0.929s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:28 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d Jul 06 12:24:28 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:29 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d" returned: 0 in 0.897s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:29 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d Jul 06 12:24:29 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:30 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f.299dea46-d799-4c6d-abd9-26e280c3590d" returned: 0 in 0.756s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-quobyte-299dea46-d799-4c6d-abd9-26e280c3590d" released by "_delete_snapshot" :: held 3.565s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-quobyte-81d5c5b0-7ef6-4ab0-a309-8960f975203f" released by "delete_snapshot" :: held 3.603s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:30 devstack cinder-volume[86706]: DEBUG cinder.quota [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Created reservations ['5720c5ca-0376-45af-bfa7-0352fefbd2e3', '4b38f7f6-523b-4634-a83a-e709e5603aa0', '767da029-38be-4cc7-8811-18b8ed6d7c2d', '5ebeedba-8539-40fd-8872-b092a7b2713e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:30 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Delete snapshot completed successfully. Jul 06 12:24:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-dc3e88bc-a4d6-4df3-b028-e9448484c4b5 req-f33e07b9-e906-4b0a-a323-22976343ad5b tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-299dea46-d799-4c6d-abd9-26e280c3590d-delete_snapshot" released by "delete_snapshot" :: held 3.763s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "cinder-81d5c5b0-7ef6-4ab0-a309-8960f975203f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-81d5c5b0-7ef6-4ab0-a309-8960f975203f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "cinder-quobyte-81d5c5b0-7ef6-4ab0-a309-8960f975203f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-quobyte-81d5c5b0-7ef6-4ab0-a309-8960f975203f" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:31 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81ed01a-7c56-4869-aeab-d5794af3e82a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:31 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f Jul 06 12:24:31 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:32 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f" returned: 0 in 0.844s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:32 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f Jul 06 12:24:32 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:32 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-81d5c5b0-7ef6-4ab0-a309-8960f975203f" returned: 0 in 0.714s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-quobyte-81d5c5b0-7ef6-4ab0-a309-8960f975203f" released by "delete_volume" :: held 1.657s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG cinder.quota [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Created reservations ['c00dc082-8d5d-4ffb-8544-f84f6ba7d9c2', '15c156f7-277b-49bc-ac1b-3effa1d5728b', '11c22a01-9079-46f1-b121-699da5eba542', 'ce190b06-6192-482d-9e7b-4ac31864a884'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:32 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:32 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:33 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.737s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:33 devstack cinder-volume[86706]: DEBUG cinder.manager [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Deleted volume successfully. Jul 06 12:24:33 devstack cinder-volume[86706]: DEBUG cinder.coordination [req-6ba3f368-d35e-4c21-9c53-e080e4599a09 req-482c05f3-63a7-45fd-98b6-ec25a6ae48cd tempest-VolumesSnapshotsTestJSON-1297801118 None] Lock "cinder-81d5c5b0-7ef6-4ab0-a309-8960f975203f-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-2818ec77-075b-49a5-ade6-412e59d4c41c req-6dd58e7b-b3da-4849-ac85-cba5a402de57 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Terminate volume connection completed successfully. Jul 06 12:24:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-2818ec77-075b-49a5-ade6-412e59d4c41c req-6dd58e7b-b3da-4849-ac85-cba5a402de57 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Deleting attachment 901904c3-dcc4-4381-8f2e-8aa8f8973911. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:24:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-39b5100a-1882-4553-83c9-134a3d5b620a req-192a114b-4bfd-4d60-84b4-07e5fb4ccc7b tempest-TestServerVolumeAttachmentScenario-1190296167 None] Terminate volume connection completed successfully. Jul 06 12:24:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-39b5100a-1882-4553-83c9-134a3d5b620a req-192a114b-4bfd-4d60-84b4-07e5fb4ccc7b tempest-TestServerVolumeAttachmentScenario-1190296167 None] Deleting attachment a115cc9a-7666-4a40-97c0-161031d7c7b7. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:24:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6dee3ec0-0647-46fd-9f7e-866a06c2f121 tempest-GroupSnapshotsTest-1718685490 None] Group tempest-GroupSnapshotsTest-Group-1760579506: creating Jul 06 12:24:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6dee3ec0-0647-46fd-9f7e-866a06c2f121 tempest-GroupSnapshotsTest-1718685490 None] Group tempest-GroupSnapshotsTest-Group-1760579506: created successfully Jul 06 12:24:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6dee3ec0-0647-46fd-9f7e-866a06c2f121 tempest-GroupSnapshotsTest-1718685490 None] Create group completed successfully. Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (e4e2e264-8df0-403b-979c-0fe97d5110fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ba1832-8280-4802-a190-cd821103345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ba1832-8280-4802-a190-cd821103345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-932210656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccb3eb7a-dd97-479d-af70-535a0b711575,host='devstack@QuobyteHD#QuobyteHD',id=90735759-3e78-4ea3-99b3-8cd8b231652c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:43Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66e8d29d-68e0-4307-87a2-770f26d94ece),volume_type_id=66e8d29d-68e0-4307-87a2-770f26d94ece)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37dbe88b-0a3b-45a2-8277-39f277ee7ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37dbe88b-0a3b-45a2-8277-39f277ee7ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e509606-e79c-4b7b-b09c-c59bf8681bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e509606-e79c-4b7b-b09c-c59bf8681bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90735759-3e78-4ea3-99b3-8cd8b231652c', 'volume_name': 'volume-90735759-3e78-4ea3-99b3-8cd8b231652c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63e5b17-06fd-4502-a250-98b77079068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63e5b17-06fd-4502-a250-98b77079068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b84ce2a-5481-4644-8086-ae192bbdfbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:43 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Volume 90735759-3e78-4ea3-99b3-8cd8b231652c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90735759-3e78-4ea3-99b3-8cd8b231652c', 'volume_size': 1} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ccb3eb7a-dd97-479d-af70-535a0b711575,created_at=2026-07-06T10:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-932210656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccb3eb7a-dd97-479d-af70-535a0b711575,host='devstack@QuobyteHD#QuobyteHD',id=90735759-3e78-4ea3-99b3-8cd8b231652c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:43Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66e8d29d-68e0-4307-87a2-770f26d94ece),volume_type_id=66e8d29d-68e0-4307-87a2-770f26d94ece)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Creating volume 90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:43 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:24:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:43 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c 1073741824 Jul 06 12:24:43 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:44 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c 1073741824" returned: 0 in 1.024s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:44 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c Jul 06 12:24:44 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:45 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b84ce2a-5481-4644-8086-ae192bbdfbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90735759-3e78-4ea3-99b3-8cd8b231652c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb6448c-fbb7-42bc-ae3f-40ba96542ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:45 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Volume volume-90735759-3e78-4ea3-99b3-8cd8b231652c (90735759-3e78-4ea3-99b3-8cd8b231652c): created successfully Jul 06 12:24:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb6448c-fbb7-42bc-ae3f-40ba96542ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (e4e2e264-8df0-403b-979c-0fe97d5110fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-83efd7dd-085e-4e57-9850-3e5b8fea5a3c tempest-GroupSnapshotsTest-1718685490 None] Created volume successfully. Jul 06 12:24:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] GroupSnapshot d6864b85-f63a-4965-94d3-b7a431804d70: creating. Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Group snapshot d6864b85-f63a-4965-94d3-b7a431804d70: creating. {{(pid=86706) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Creating offline snapshot 810361ec-d6cf-49fb-900a-e35d3f9facc4 of volume 90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d0d6f7-b96d-4fd6-a138-6fd5b70ebf8a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:46 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c Jul 06 12:24:46 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:46 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c" returned: 0 in 0.892s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:46 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 1G Jul 06 12:24:46 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 1G" returned: 0 in 0.952s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90735759-3e78-4ea3-99b3-8cd8b231652c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:47 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:47 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90735759-3e78-4ea3-99b3-8cd8b231652c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 Jul 06 12:24:47 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:48 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "cinder-9813ba4c-34ff-414a-9f01-df437457f2fb-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90735759-3e78-4ea3-99b3-8cd8b231652c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:48 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-9813ba4c-34ff-414a-9f01-df437457f2fb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:48 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 Jul 06 12:24:48 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "cinder-quobyte-9813ba4c-34ff-414a-9f01-df437457f2fb" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-quobyte-9813ba4c-34ff-414a-9f01-df437457f2fb" acquired by "delete_volume" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[645a11fb-e9ad-4a8c-ac89-d7533185677f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:48 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb Jul 06 12:24:48 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:49 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4" returned: 0 in 0.740s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:49 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.info Jul 06 12:24:49 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:49 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb" returned: 0 in 0.831s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:49 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb Jul 06 12:24:49 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:50 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.info" returned: 0 in 0.725s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:50 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:50 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.info Jul 06 12:24:50 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:50 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9813ba4c-34ff-414a-9f01-df437457f2fb" returned: 0 in 0.685s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-quobyte-9813ba4c-34ff-414a-9f01-df437457f2fb" released by "delete_volume" :: held 1.556s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Created reservations ['59a34a2b-2e62-4f62-a27e-07d8e7454773', '0e10364f-c7d4-47c8-a3e5-03a8c557046b', '5b1f38ff-c12b-416a-bea1-4818c892775d', '0c756480-336a-4eed-92ab-6e48f4306cdf'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:50 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:50 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:50 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.info" returned: 0 in 0.679s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.894s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "cinder-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a5e5ae1d-1e90-44b5-af8b-d93f0ffd6a7c tempest-GroupSnapshotsTest-1718685490 None] group_snapshot d6864b85-f63a-4965-94d3-b7a431804d70: created successfully Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "cinder-quobyte-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-quobyte-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae37ae6-2f98-4a87-a7f7-939b12986f05]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:51 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.759s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Deleted volume successfully. Jul 06 12:24:51 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 Jul 06 12:24:51 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b3f63177-6c14-4bec-ba2d-75c22969bd34 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-9813ba4c-34ff-414a-9f01-df437457f2fb-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:52 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8" returned: 0 in 0.875s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:52 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8 Jul 06 12:24:52 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-810361ec-d6cf-49fb-900a-e35d3f9facc4-626deace-cc82-4b12-a12b-f75d629778db" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-810361ec-d6cf-49fb-900a-e35d3f9facc4-626deace-cc82-4b12-a12b-f75d629778db" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Creating volume 626deace-cc82-4b12-a12b-f75d629778db from snapshot 810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-626deace-cc82-4b12-a12b-f75d629778db" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-626deace-cc82-4b12-a12b-f75d629778db" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] snapshot: 810361ec-d6cf-49fb-900a-e35d3f9facc4, volume: 626deace-cc82-4b12-a12b-f75d629778db, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[989bff8a-fa15-4e85-95fe-f4035a566431]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:52 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 Jul 06 12:24:52 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:52 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8" returned: 0 in 0.696s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-quobyte-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8" released by "delete_volume" :: held 1.615s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Created reservations ['a7fb83ad-e743-4806-b223-4d4409c1f8c6', '497d853a-6300-41bd-ad21-03f6f794f346', '5deac17f-03b7-4369-b17b-aadacf953fd5', '6a633185-6ded-4a80-98f8-78f6cbf41162'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:52 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:24:52 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:53 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4" returned: 0 in 0.873s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90735759-3e78-4ea3-99b3-8cd8b231652c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75fb285-fdd6-4350-bc80-7428d8a3ec75]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:53 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c Jul 06 12:24:53 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:53 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.748s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Deleted volume successfully. Jul 06 12:24:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-24d3b7bc-e46b-44ea-bf50-3a0925ddb382 tempest-TestServerVolumeAttachmentScenario-1190296167 None] Lock "cinder-a2741cbc-5b01-4cd3-9e1c-a6d06cbc13a8-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:54 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c" returned: 0 in 0.883s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:54 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:24:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:54 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db Jul 06 12:24:54 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:00 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db" returned: 0 in 5.632s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e954d3-19a8-4a8c-b77a-94951138a55f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:00 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c Jul 06 12:25:00 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:01 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c" returned: 0 in 1.018s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:25:01 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Converted 1024.00 MB image at 181.75 MB/s Jul 06 12:25:01 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:01 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db Jul 06 12:25:01 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:01 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db" returned: 0 in 0.659s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-626deace-cc82-4b12-a12b-f75d629778db" released by "_copy_volume_from_snapshot" :: held 9.228s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-810361ec-d6cf-49fb-900a-e35d3f9facc4-626deace-cc82-4b12-a12b-f75d629778db" released by "_create_volume_from_snapshot" :: held 9.272s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.289s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=100,cinder:SELECT=78,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:25:01 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=80,cinder:SELECT=81,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:25:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2d7e1aff-3f0b-430c-bf0f-bfa55c4d5148 tempest-GroupSnapshotsTest-1718685490 None] Create group from source-snapshot-d6864b85-f63a-4965-94d3-b7a431804d70 completed successfully. Jul 06 12:25:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-626deace-cc82-4b12-a12b-f75d629778db" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-626deace-cc82-4b12-a12b-f75d629778db" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92cfb74-1f49-4216-8094-7ce1183bd95b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:02 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db Jul 06 12:25:02 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:03 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db" returned: 0 in 0.974s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:03 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db Jul 06 12:25:03 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:04 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-626deace-cc82-4b12-a12b-f75d629778db" returned: 0 in 0.704s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-626deace-cc82-4b12-a12b-f75d629778db" released by "delete_volume" :: held 1.739s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['525d27d7-2fcf-4696-a8af-f4a3541a5672'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:04 devstack cinder-volume[86706]: WARNING cinder.quota [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2144519725 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2144519725, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:04 devstack cinder-volume[86706]: WARNING cinder.quota [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2144519725 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2144519725, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['fb96d7e3-c2eb-429b-9cd1-efa9e125baa7', 'a60eaabb-0c5e-4f20-8f01-d452adfe2c1c', '34fe08c3-22c7-4eae-bc5c-90a7d6ed0e8f', '3ba2ffe3-6938-48f2-a0de-7030901dd7f6'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:04 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:25:04 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:04 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] group_snapshot d6864b85-f63a-4965-94d3-b7a431804d70: deleting Jul 06 12:25:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] group_snapshot d6864b85-f63a-4965-94d3-b7a431804d70: deleting {{(pid=86706) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-90735759-3e78-4ea3-99b3-8cd8b231652c" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-90735759-3e78-4ea3-99b3-8cd8b231652c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-810361ec-d6cf-49fb-900a-e35d3f9facc4" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-810361ec-d6cf-49fb-900a-e35d3f9facc4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Deleting offline snapshot 810361ec-d6cf-49fb-900a-e35d3f9facc4 of volume 90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] snapshot_file for this snap is: volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[203556dd-cec9-4bdd-8996-98bdb872c100]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:05 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 Jul 06 12:25:05 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:05 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.788s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:05 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e2177b6d-b83d-46b2-ba01-1e3c715ce2e9 tempest-GroupSnapshotsTest-1718685490 None] Delete group completed successfully. Jul 06 12:25:06 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4" returned: 0 in 0.958s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90735759-3e78-4ea3-99b3-8cd8b231652c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:25:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[05424224-8afb-423b-90f1-52d27afb6fe5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:06 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c Jul 06 12:25:06 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:06 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c" returned: 0 in 0.873s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:07 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 Jul 06 12:25:07 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:07 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4" returned: 0 in 0.810s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:07 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4 Jul 06 12:25:07 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:08 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c.810361ec-d6cf-49fb-900a-e35d3f9facc4" returned: 0 in 0.751s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-810361ec-d6cf-49fb-900a-e35d3f9facc4" released by "_delete_snapshot" :: held 3.529s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-90735759-3e78-4ea3-99b3-8cd8b231652c" released by "delete_snapshot" :: held 3.557s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:08 devstack cinder-volume[86706]: WARNING cinder.quota [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2144519725 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2144519725, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:08 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['de70f7ff-f328-448b-baeb-67b9fc23e9d7', '19bdd2cd-b9e2-41e4-bef7-0b55edf9fdbf', '1d455ba6-c5d8-4654-b839-bac4fc391fe6', 'fd330075-900a-4180-be7a-44caf64c8229'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6bd2b838-644b-442c-9087-260484abceff tempest-GroupSnapshotsTest-1718685490 None] group_snapshot d6864b85-f63a-4965-94d3-b7a431804d70: deleted successfully Jul 06 12:25:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-90735759-3e78-4ea3-99b3-8cd8b231652c" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-90735759-3e78-4ea3-99b3-8cd8b231652c" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:09 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe0fffe-c355-4017-a2d6-3a6b46e67d32]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:09 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c Jul 06 12:25:09 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:10 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c" returned: 0 in 0.863s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:10 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c Jul 06 12:25:10 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:11 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-90735759-3e78-4ea3-99b3-8cd8b231652c" returned: 0 in 0.759s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-90735759-3e78-4ea3-99b3-8cd8b231652c" released by "delete_volume" :: held 1.707s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['d5b6b80c-be98-49ad-b08e-816a7031b638'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:11 devstack cinder-volume[86706]: WARNING cinder.db.api [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2144519725'] Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['5ed99063-e008-462c-9480-35f06d008dd8', '03ffaa1a-8949-4062-838f-edc0912d2b52', '79fa4f69-4dd5-4494-b66a-f1d5868dad74', '13a8dfd2-7efa-4c5c-b6b0-92e7133952a8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:11 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:25:11 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:12 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.894s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f32d47f6-1166-4161-a528-74d26ae6fab3 tempest-GroupSnapshotsTest-1718685490 None] Delete group completed successfully. Jul 06 12:25:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a1a9820d-ed96-4042-872c-c43ca3145d99 tempest-GroupSnapshotsTest-1718685490 None] Group tempest-GroupSnapshotsTest-Group-2145482775: creating Jul 06 12:25:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a1a9820d-ed96-4042-872c-c43ca3145d99 tempest-GroupSnapshotsTest-1718685490 None] Group tempest-GroupSnapshotsTest-Group-2145482775: created successfully Jul 06 12:25:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a1a9820d-ed96-4042-872c-c43ca3145d99 tempest-GroupSnapshotsTest-1718685490 None] Create group completed successfully. Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (6e383305-3df8-4570-a131-61b0c711d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84acc4a3-433e-4bcf-92b7-733539f5324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84acc4a3-433e-4bcf-92b7-733539f5324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1522991180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=584af64c-17f8-4c67-8fdd-f33916639f70,host='devstack@QuobyteHD#QuobyteHD',id=3a4d0f87-99f9-4a93-a814-88e26365a06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:14Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe09d42-0ed6-4b6e-a953-18885bdb1fd2),volume_type_id=3fe09d42-0ed6-4b6e-a953-18885bdb1fd2)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9ad72b-2612-4921-bb02-8bc97616f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9ad72b-2612-4921-bb02-8bc97616f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30ce549-f86b-4b5f-8ff7-a2225efd3012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30ce549-f86b-4b5f-8ff7-a2225efd3012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4d0f87-99f9-4a93-a814-88e26365a06c', 'volume_name': 'volume-3a4d0f87-99f9-4a93-a814-88e26365a06c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d011a8e9-5c46-4de6-9fe0-12926efc612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d011a8e9-5c46-4de6-9fe0-12926efc612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df3ba74-7eb3-4c38-a16d-1b0f68415d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:14 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Volume 3a4d0f87-99f9-4a93-a814-88e26365a06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4d0f87-99f9-4a93-a814-88e26365a06c', 'volume_size': 1} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=584af64c-17f8-4c67-8fdd-f33916639f70,created_at=2026-07-06T10:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1522991180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=584af64c-17f8-4c67-8fdd-f33916639f70,host='devstack@QuobyteHD#QuobyteHD',id=3a4d0f87-99f9-4a93-a814-88e26365a06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:14Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe09d42-0ed6-4b6e-a953-18885bdb1fd2),volume_type_id=3fe09d42-0ed6-4b6e-a953-18885bdb1fd2)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Creating volume 3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:14 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:25:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:14 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c 1073741824 Jul 06 12:25:14 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:15 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c 1073741824" returned: 0 in 1.069s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:15 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c Jul 06 12:25:15 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:16 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c" returned: 0 in 0.824s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:25:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df3ba74-7eb3-4c38-a16d-1b0f68415d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4d0f87-99f9-4a93-a814-88e26365a06c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f94e1db-e60d-4e17-b3db-2d00ad982003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:16 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Volume volume-3a4d0f87-99f9-4a93-a814-88e26365a06c (3a4d0f87-99f9-4a93-a814-88e26365a06c): created successfully Jul 06 12:25:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f94e1db-e60d-4e17-b3db-2d00ad982003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (6e383305-3df8-4570-a131-61b0c711d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:16 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-08ef2619-4595-412e-a8ad-03575af93eca tempest-GroupSnapshotsTest-1718685490 None] Created volume successfully. Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (56caea37-0e08-4f11-9b40-505f275dc0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce8c4e6-5e70-4364-960c-e6cda6292f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce8c4e6-5e70-4364-960c-e6cda6292f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-373906983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=584af64c-17f8-4c67-8fdd-f33916639f70,host='devstack@QuobyteHD#QuobyteHD',id=89fe4ebf-07c6-4fa5-b1ef-580719a89fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:18Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe09d42-0ed6-4b6e-a953-18885bdb1fd2),volume_type_id=3fe09d42-0ed6-4b6e-a953-18885bdb1fd2)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af24b9ce-e78e-49df-b1b5-931016ae4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af24b9ce-e78e-49df-b1b5-931016ae4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c64cecb-448d-4bce-a755-473a1791fd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c64cecb-448d-4bce-a755-473a1791fd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fe4ebf-07c6-4fa5-b1ef-580719a89fa1', 'volume_name': 'volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7672fd9-b49e-4ade-9ad2-379a70d22dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7672fd9-b49e-4ade-9ad2-379a70d22dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8522ef6-eafe-4d71-8ebc-324351fff98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:17 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Volume 89fe4ebf-07c6-4fa5-b1ef-580719a89fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1', 'volume_size': 1} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=584af64c-17f8-4c67-8fdd-f33916639f70,created_at=2026-07-06T10:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-373906983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=584af64c-17f8-4c67-8fdd-f33916639f70,host='devstack@QuobyteHD#QuobyteHD',id=89fe4ebf-07c6-4fa5-b1ef-580719a89fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:18Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe09d42-0ed6-4b6e-a953-18885bdb1fd2),volume_type_id=3fe09d42-0ed6-4b6e-a953-18885bdb1fd2)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Creating volume 89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:17 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:25:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:17 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 1073741824 Jul 06 12:25:17 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:18 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 1073741824" returned: 0 in 1.049s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:18 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 Jul 06 12:25:18 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:19 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" returned: 0 in 0.856s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:25:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8522ef6-eafe-4d71-8ebc-324351fff98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee736b1-b5df-419d-b2cf-7a2a57d8227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:19 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Volume volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 (89fe4ebf-07c6-4fa5-b1ef-580719a89fa1): created successfully Jul 06 12:25:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee736b1-b5df-419d-b2cf-7a2a57d8227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (56caea37-0e08-4f11-9b40-505f275dc0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:19 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c0dfca21-530c-4fd0-9f8b-98a8160afa43 tempest-GroupSnapshotsTest-1718685490 None] Created volume successfully. Jul 06 12:25:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7bc80483-9855-4c8e-b6b7-1e096999561b tempest-GroupSnapshotsTest-1718685490 None] Update group completed successfully. Jul 06 12:25:21 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7951244f-1747-418c-bbe8-614d007252aa tempest-GroupSnapshotsTest-1718685490 None] Update group completed successfully. Jul 06 12:25:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fc83fed9-f2a4-4aa4-899f-2e750c109a1c tempest-GroupSnapshotsTest-1718685490 None] Update group completed successfully. Jul 06 12:25:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7c23ccb0-2b59-4cbd-beb4-6f2feac7ec7c tempest-GroupSnapshotsTest-1718685490 None] Update group completed successfully. Jul 06 12:25:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] GroupSnapshot 8d1787bc-befb-4faa-a1b5-46b356c0e609: creating. Jul 06 12:25:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Group snapshot 8d1787bc-befb-4faa-a1b5-46b356c0e609: creating. {{(pid=86706) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:25:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Creating offline snapshot 3b18433f-9ed6-4f3c-95a9-7e24852f8a1d of volume 3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:25:25 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747979e-3990-4a4d-bf73-79491d112e23]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:25 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c Jul 06 12:25:25 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:26 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c" returned: 0 in 0.900s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:26 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d 1G Jul 06 12:25:26 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:26 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:27 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:25:27 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:27 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d 1G" returned: 0 in 1.011s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4d0f87-99f9-4a93-a814-88e26365a06c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:27 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4d0f87-99f9-4a93-a814-88e26365a06c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d Jul 06 12:25:27 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:27 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.814s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:25:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:25:28 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4d0f87-99f9-4a93-a814-88e26365a06c -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" returned: 0 in 0.870s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:28 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:28 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d Jul 06 12:25:28 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:29 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" returned: 0 in 0.734s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:29 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.info Jul 06 12:25:29 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:30 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.info" returned: 0 in 0.764s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:30 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:30 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.info Jul 06 12:25:30 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:30 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.info" returned: 0 in 0.712s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.098s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Creating offline snapshot 67529217-d5f5-463d-b09f-8c09f47a745f of volume 89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7dde94-66e5-4ad5-acbd-f294c27970b2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:30 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 Jul 06 12:25:30 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:31 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" returned: 0 in 0.904s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:31 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f 1G Jul 06 12:25:31 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:32 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f 1G" returned: 0 in 1.012s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:32 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f Jul 06 12:25:32 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:33 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f" returned: 0 in 0.900s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:33 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:33 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f Jul 06 12:25:33 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:34 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f" returned: 0 in 0.793s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:34 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.info Jul 06 12:25:34 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:35 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.info" returned: 0 in 0.693s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:35 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:35 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.info Jul 06 12:25:35 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:35 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.info" returned: 0 in 0.829s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.243s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Flow 'volume_create_manager' (a1d30563-8f3a-4c0b-b6e7-7ccdba99940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3841ecab-a84a-4657-b9e3-dc45fdcfbf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3841ecab-a84a-4657-b9e3-dc45fdcfbf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1992105138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3ffe4ad9fe4494a82ccc20a10e9627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:36Z,use_quota=True,user_id='16dbeac777f1419cacc19fede2266b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c41878-4b17-40ce-ad10-25dc8def048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c41878-4b17-40ce-ad10-25dc8def048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11643a50-395b-411b-849b-12e107ca9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11643a50-395b-411b-849b-12e107ca9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5', 'volume_name': 'volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6e10ae-6054-4854-8469-963cc566764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6e10ae-6054-4854-8469-963cc566764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3184b7-3dac-4892-84fa-77e717393d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Volume 70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5', 'volume_size': 1} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1992105138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3ffe4ad9fe4494a82ccc20a10e9627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:36Z,use_quota=True,user_id='16dbeac777f1419cacc19fede2266b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Creating volume 70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:36 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:25:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:36 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 1073741824 Jul 06 12:25:36 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fa33e719-6b57-434a-8340-0cf4179de840 tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 8d1787bc-befb-4faa-a1b5-46b356c0e609: created successfully Jul 06 12:25:37 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 1073741824" returned: 0 in 0.976s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:37 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:25:37 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 8d1787bc-befb-4faa-a1b5-46b356c0e609: deleting Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 8d1787bc-befb-4faa-a1b5-46b356c0e609: deleting {{(pid=86706) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-3a4d0f87-99f9-4a93-a814-88e26365a06c" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-3a4d0f87-99f9-4a93-a814-88e26365a06c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Deleting offline snapshot 3b18433f-9ed6-4f3c-95a9-7e24852f8a1d of volume 3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] snapshot_file for this snap is: volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c58dad5-bf77-4a17-a4f8-10705dddb53a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:37 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d Jul 06 12:25:37 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:38 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 0.844s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3184b7-3dac-4892-84fa-77e717393d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12397a21-086d-4aaa-929a-ddb9103038c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:38 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Volume volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 (70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5): created successfully Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12397a21-086d-4aaa-929a-ddb9103038c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Flow 'volume_create_manager' (a1d30563-8f3a-4c0b-b6e7-7ccdba99940f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:38 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-35191fc6-5d7e-49cc-aa44-a4efa5a3774c tempest-TestStampPattern-778066226 None] Created volume successfully. Jul 06 12:25:38 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" returned: 0 in 0.884s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a4d0f87-99f9-4a93-a814-88e26365a06c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b63b79-9450-422f-9c3c-fd16f18d41be]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:38 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c Jul 06 12:25:38 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:39 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:39 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d Jul 06 12:25:39 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:39 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" returned: 0 in 0.738s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:40 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d Jul 06 12:25:40 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:40 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c.3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" returned: 0 in 0.713s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-3b18433f-9ed6-4f3c-95a9-7e24852f8a1d" released by "_delete_snapshot" :: held 3.173s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-3a4d0f87-99f9-4a93-a814-88e26365a06c" released by "delete_snapshot" :: held 3.197s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-67529217-d5f5-463d-b09f-8c09f47a745f" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-67529217-d5f5-463d-b09f-8c09f47a745f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Deleting offline snapshot 67529217-d5f5-463d-b09f-8c09f47a745f of volume 89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] snapshot_file for this snap is: volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f64073-bdc8-4be3-a9c0-a24e660c6fa7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:40 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f Jul 06 12:25:40 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:41 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f" returned: 0 in 0.778s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:25:41 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506fb9b-21ef-4e9c-9a94-3328ca4f58b9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:41 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 Jul 06 12:25:41 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:42 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" returned: 0 in 0.872s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:42 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f Jul 06 12:25:42 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:43 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f" returned: 0 in 0.842s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:43 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f Jul 06 12:25:43 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:44 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1.67529217-d5f5-463d-b09f-8c09f47a745f" returned: 0 in 0.733s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-67529217-d5f5-463d-b09f-8c09f47a745f" released by "_delete_snapshot" :: held 3.345s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" released by "delete_snapshot" :: held 3.372s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:44 devstack cinder-volume[86706]: WARNING cinder.quota [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1712026402 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1712026402, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:44 devstack cinder-volume[86706]: WARNING cinder.quota [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1712026402 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1712026402, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:44 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['d58ea8af-a142-49ac-b9d8-11194ae55d1b', '1219b38a-3971-4e4b-8bf6-50fb33878db0', 'ce66813b-a5ef-4803-bd2d-77d799e91940', '37dc1aa3-c421-4a34-ae29-cfb020bc3982'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:44 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['9fcef397-ab39-418e-a035-dac78404013b', '084a3e7b-415c-4b72-aa4c-0d5ffc674112', '1b949050-28ba-4f29-a068-c095b2d44883', '086a56f3-ac9f-4587-914a-e2be6d85bc73'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-939357ab-6b81-455a-9a63-7e2121f37c71 tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 8d1787bc-befb-4faa-a1b5-46b356c0e609: deleted successfully Jul 06 12:25:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-3a4d0f87-99f9-4a93-a814-88e26365a06c" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-3a4d0f87-99f9-4a93-a814-88e26365a06c" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e99111-8277-477c-b068-9ab047fb0482]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:45 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c Jul 06 12:25:45 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:46 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c" returned: 0 in 0.858s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:46 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c Jul 06 12:25:46 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:47 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3a4d0f87-99f9-4a93-a814-88e26365a06c" returned: 0 in 0.734s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-3a4d0f87-99f9-4a93-a814-88e26365a06c" released by "delete_volume" :: held 1.670s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:47 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[20146ede-351a-40c1-b1f4-b13412f2c41f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:47 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 Jul 06 12:25:47 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:48 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" returned: 0 in 0.927s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:48 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1 Jul 06 12:25:48 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:49 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" returned: 0 in 0.860s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-89fe4ebf-07c6-4fa5-b1ef-580719a89fa1" released by "delete_volume" :: held 1.859s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['32abe77c-5939-4d08-b4bb-9aa853e3f1a5'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:49 devstack cinder-volume[86706]: WARNING cinder.quota [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1712026402 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1712026402, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['0b34da12-1cd5-428c-a4dd-5dfff606c06f', '404adec1-0f57-4be5-b77c-1529bc302b16', '7ab46c82-277d-4e71-a2c6-e1a2e1e448ba', 'fdb96267-81d8-4b10-96c5-dcf09d25ee88'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['e3e0b155-ada5-441e-8d32-d70f815b49e9', '1791f3ce-1479-4f4e-b5e7-e7b947f64eee', 'f355bbc4-d305-4ba3-9935-08e5d3fe8ef9', 'a709280b-da02-4877-a583-4fb3d4609f5b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:49 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:25:49 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:50 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.873s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:50 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-12cefe81-fd1f-45de-8d83-c7427919c99a tempest-GroupSnapshotsTest-1718685490 None] Delete group completed successfully. Jul 06 12:25:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-81d68b38-69a3-431b-b910-ce0be676aedb tempest-GroupSnapshotsTest-1718685490 None] Group tempest-GroupSnapshotsTest-Group-1280325066: creating Jul 06 12:25:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-81d68b38-69a3-431b-b910-ce0be676aedb tempest-GroupSnapshotsTest-1718685490 None] Group tempest-GroupSnapshotsTest-Group-1280325066: created successfully Jul 06 12:25:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-81d68b38-69a3-431b-b910-ce0be676aedb tempest-GroupSnapshotsTest-1718685490 None] Create group completed successfully. Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (a5a0102d-3388-4d8d-89f6-2aff0410fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af4055c-2b0a-4191-b80d-ac775028cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af4055c-2b0a-4191-b80d-ac775028cc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815946597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5fc6a6f-a2e1-4e3c-9228-6760a8d79cb4,host='devstack@QuobyteHD#QuobyteHD',id=1fb9237f-4768-49a0-98fc-a82966fea6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:53Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3855cd34-8036-499d-bb27-6c2b04d8b3f1),volume_type_id=3855cd34-8036-499d-bb27-6c2b04d8b3f1)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a18dfd-f685-4e24-bd99-0e2a7badad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a18dfd-f685-4e24-bd99-0e2a7badad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5937e5b6-3dc6-455c-9b00-60307803da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5937e5b6-3dc6-455c-9b00-60307803da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb9237f-4768-49a0-98fc-a82966fea6d9', 'volume_name': 'volume-1fb9237f-4768-49a0-98fc-a82966fea6d9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ac9d5c-07ee-4235-abdd-da4a7c1f9989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ac9d5c-07ee-4235-abdd-da4a7c1f9989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c2b7d-dffa-4a74-ad0e-7ccc696ea971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:53 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Volume 1fb9237f-4768-49a0-98fc-a82966fea6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb9237f-4768-49a0-98fc-a82966fea6d9', 'volume_size': 1} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c5fc6a6f-a2e1-4e3c-9228-6760a8d79cb4,created_at=2026-07-06T10:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815946597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5fc6a6f-a2e1-4e3c-9228-6760a8d79cb4,host='devstack@QuobyteHD#QuobyteHD',id=1fb9237f-4768-49a0-98fc-a82966fea6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db89928f7234be9bb478e4843a6a50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:53Z,use_quota=True,user_id='d88e74fcf41c44858543535bffbc7642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3855cd34-8036-499d-bb27-6c2b04d8b3f1),volume_type_id=3855cd34-8036-499d-bb27-6c2b04d8b3f1)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Creating volume 1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:53 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:25:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:53 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 1073741824 Jul 06 12:25:53 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:54 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 1073741824" returned: 0 in 1.154s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:54 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 Jul 06 12:25:54 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:55 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9" returned: 0 in 0.721s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:25:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c2b7d-dffa-4a74-ad0e-7ccc696ea971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb9237f-4768-49a0-98fc-a82966fea6d9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d918102a-231f-48de-9eee-33742228875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Volume volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 (1fb9237f-4768-49a0-98fc-a82966fea6d9): created successfully Jul 06 12:25:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d918102a-231f-48de-9eee-33742228875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Flow 'volume_create_manager' (a5a0102d-3388-4d8d-89f6-2aff0410fa95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:55 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-39e6768b-0d2a-4131-bb3d-250d70940bd8 tempest-GroupSnapshotsTest-1718685490 None] Created volume successfully. Jul 06 12:25:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] GroupSnapshot 614bfbe9-ffa4-43d8-bd7e-0517afe911fa: creating. Jul 06 12:25:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Group snapshot 614bfbe9-ffa4-43d8-bd7e-0517afe911fa: creating. {{(pid=86706) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:25:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Creating offline snapshot 93f74a59-684b-49d8-9afd-5b8ae003933d of volume 1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:25:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d422d1c9-aad1-4d0e-89fa-45dace601ce6]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:56 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 Jul 06 12:25:56 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:57 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9" returned: 0 in 0.840s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:57 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d 1G Jul 06 12:25:57 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:58 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d 1G" returned: 0 in 0.943s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:58 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d Jul 06 12:25:58 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:58 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d" returned: 0 in 0.786s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:58 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:59 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d Jul 06 12:25:59 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:59 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d" returned: 0 in 0.662s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:59 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.info Jul 06 12:25:59 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:00 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.info" returned: 0 in 0.676s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:00 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:26:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:00 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.info Jul 06 12:26:00 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:01 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.info" returned: 0 in 0.668s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.698s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3e06ead4-4f43-4bbc-a96c-052b060b726d tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 614bfbe9-ffa4-43d8-bd7e-0517afe911fa: created successfully Jul 06 12:26:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 614bfbe9-ffa4-43d8-bd7e-0517afe911fa: deleting Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 614bfbe9-ffa4-43d8-bd7e-0517afe911fa: deleting {{(pid=86706) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-1fb9237f-4768-49a0-98fc-a82966fea6d9" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-1fb9237f-4768-49a0-98fc-a82966fea6d9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-93f74a59-684b-49d8-9afd-5b8ae003933d" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-93f74a59-684b-49d8-9afd-5b8ae003933d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Deleting offline snapshot 93f74a59-684b-49d8-9afd-5b8ae003933d of volume 1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] snapshot_file for this snap is: volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e34bdc4-6793-4d09-8ab0-23cdc824a8cb]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:02 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d Jul 06 12:26:02 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:02 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d" returned: 0 in 0.805s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fb9237f-4768-49a0-98fc-a82966fea6d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:26:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c1fdb7-ff64-4f21-ae83-c786ca6eb00d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:02 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 Jul 06 12:26:02 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:03 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:03 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d Jul 06 12:26:03 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:04 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d" returned: 0 in 0.865s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:04 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d Jul 06 12:26:04 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:05 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9.93f74a59-684b-49d8-9afd-5b8ae003933d" returned: 0 in 0.645s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-93f74a59-684b-49d8-9afd-5b8ae003933d" released by "_delete_snapshot" :: held 3.254s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-1fb9237f-4768-49a0-98fc-a82966fea6d9" released by "delete_snapshot" :: held 3.283s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:05 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=85,cinder:SELECT=89,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:05 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=83,cinder:UPDATE=81,cinder:INSERT=23,cinder:DELETE=2 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:05 devstack cinder-volume[86706]: WARNING cinder.quota [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1737788779 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1737788779, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:05 devstack cinder-volume[86706]: WARNING cinder.quota [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1737788779 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1737788779, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['0e8c8c6f-c4bc-4722-ad57-f3a477410745', '2702e022-60f5-4d10-b8a4-dbb6fcd1d21c', '9e8d9f91-5acd-4852-860f-9443fdcaf21c', 'efbc9b4c-7f6a-4ad3-8d07-4f61d76205cd'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8afb8627-6694-4a1b-a8e2-f176d29d1c2d tempest-GroupSnapshotsTest-1718685490 None] group_snapshot 614bfbe9-ffa4-43d8-bd7e-0517afe911fa: deleted successfully Jul 06 12:26:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "cinder-quobyte-1fb9237f-4768-49a0-98fc-a82966fea6d9" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-1fb9237f-4768-49a0-98fc-a82966fea6d9" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecee935-b1b9-4124-b2c6-14ceae32de2b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:06 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 Jul 06 12:26:06 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:07 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9" returned: 0 in 0.845s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:07 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9 Jul 06 12:26:07 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:08 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1fb9237f-4768-49a0-98fc-a82966fea6d9" returned: 0 in 0.715s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Lock "cinder-quobyte-1fb9237f-4768-49a0-98fc-a82966fea6d9" released by "delete_volume" :: held 1.624s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['216b4d10-12b9-4874-b1a0-63a2d4f4b65a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:08 devstack cinder-volume[86706]: WARNING cinder.quota [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1737788779 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1737788779, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Created reservations ['1ca1a546-00f3-40d0-b4f3-4ea4c92e6a89', 'cb7405cc-a3d2-4e8f-bf75-278892780e54', 'c6a50f07-b498-4cda-9fec-18b53e9330d9', 'c2e606f4-0708-421c-ad4d-43c6c85601c0'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:08 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:26:08 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:09 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.751s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:09 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7e51e63f-62ee-4d20-b090-688b4c9d420b tempest-GroupSnapshotsTest-1718685490 None] Delete group completed successfully. Jul 06 12:26:18 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=14 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:18 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=19 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06530b9a-5a02-41cb-ba35-eacbed5dd3c8 req-eca21062-06e0-41cf-a6ca-b077d259d6be tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06530b9a-5a02-41cb-ba35-eacbed5dd3c8 req-eca21062-06e0-41cf-a6ca-b077d259d6be tempest-TestStampPattern-778066226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:20 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb00c3-c135-4de9-9e3d-37bef41a6efe]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-06530b9a-5a02-41cb-ba35-eacbed5dd3c8 req-eca21062-06e0-41cf-a6ca-b077d259d6be tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:20 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:26:20 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:20 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-06530b9a-5a02-41cb-ba35-eacbed5dd3c8 req-eca21062-06e0-41cf-a6ca-b077d259d6be tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 0.829s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-06530b9a-5a02-41cb-ba35-eacbed5dd3c8 req-eca21062-06e0-41cf-a6ca-b077d259d6be tempest-TestStampPattern-778066226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-06530b9a-5a02-41cb-ba35-eacbed5dd3c8 req-eca21062-06e0-41cf-a6ca-b077d259d6be tempest-TestStampPattern-778066226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f90d76e1-dfe4-44b7-9fce-6d6230b77eb4', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:26:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-06530b9a-5a02-41cb-ba35-eacbed5dd3c8 req-eca21062-06e0-41cf-a6ca-b077d259d6be tempest-TestStampPattern-778066226 None] attachment_update completed successfully. Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:27 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:26:27 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:27 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:26:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:26:30 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-9d6e0e29-abc5-4cdc-8c0c-32c3b51e8b6b req-6af437e0-2363-43a0-b003-b02b04915e8a tempest-TestStampPattern-778066226 None] Terminate volume connection completed successfully. Jul 06 12:26:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-9d6e0e29-abc5-4cdc-8c0c-32c3b51e8b6b req-6af437e0-2363-43a0-b003-b02b04915e8a tempest-TestStampPattern-778066226 None] Deleting attachment f90d76e1-dfe4-44b7-9fce-6d6230b77eb4. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:26:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Creating offline snapshot db4004bb-d9f4-43b5-a78f-50684ad06e12 of volume 70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:26:32 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7ca055-d644-4906-879b-a9924aa694ed]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:32 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:26:32 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:33 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 0.931s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:33 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 1G Jul 06 12:26:33 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:34 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 1G" returned: 0 in 0.902s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:34 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 Jul 06 12:26:34 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:35 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12" returned: 0 in 0.888s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:35 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 is being set with open permissions: ugo+rw Jul 06 12:26:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:35 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 Jul 06 12:26:35 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:35 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12" returned: 0 in 0.811s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:35 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.info Jul 06 12:26:35 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:36 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.info" returned: 0 in 0.707s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:36 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.info is being set with open permissions: ugo+rw Jul 06 12:26:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:36 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.info Jul 06 12:26:36 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:37 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.info" returned: 0 in 0.764s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.112s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d7c4f694-7e5b-44ba-8137-b072a6a61de6 tempest-TestStampPattern-778066226 None] Create snapshot completed successfully Jul 06 12:26:45 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:47 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Flow 'volume_create_manager' (2ef852ef-171c-423b-9404-6e04bf6a5701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097e44a9-80c1-4a1a-9de6-7163a718ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097e44a9-80c1-4a1a-9de6-7163a718ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-76967428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f089b5f-b603-4848-8f22-f6079b2abb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3ffe4ad9fe4494a82ccc20a10e9627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db4004bb-d9f4-43b5-a78f-50684ad06e12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:49Z,use_quota=True,user_id='16dbeac777f1419cacc19fede2266b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e0433c-7b3c-4873-8eed-328234f35169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e0433c-7b3c-4873-8eed-328234f35169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42189c9d-66a4-498d-84fd-977057fb38c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42189c9d-66a4-498d-84fd-977057fb38c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f089b5f-b603-4848-8f22-f6079b2abb9a', 'volume_name': 'volume-7f089b5f-b603-4848-8f22-f6079b2abb9a', 'volume_size': 1, 'snapshot_id': 'db4004bb-d9f4-43b5-a78f-50684ad06e12'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9271150-3b3f-406a-95c7-299f70dd648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9271150-3b3f-406a-95c7-299f70dd648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc06ccc1-50e9-4fae-b8fd-1789c8a1c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:49 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Volume 7f089b5f-b603-4848-8f22-f6079b2abb9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f089b5f-b603-4848-8f22-f6079b2abb9a', 'volume_size': 1, 'snapshot_id': 'db4004bb-d9f4-43b5-a78f-50684ad06e12'} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-quobyte-db4004bb-d9f4-43b5-a78f-50684ad06e12-7f089b5f-b603-4848-8f22-f6079b2abb9a" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-db4004bb-d9f4-43b5-a78f-50684ad06e12-7f089b5f-b603-4848-8f22-f6079b2abb9a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Creating volume 7f089b5f-b603-4848-8f22-f6079b2abb9a from snapshot db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-quobyte-7f089b5f-b603-4848-8f22-f6079b2abb9a" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-7f089b5f-b603-4848-8f22-f6079b2abb9a" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] snapshot: db4004bb-d9f4-43b5-a78f-50684ad06e12, volume: 7f089b5f-b603-4848-8f22-f6079b2abb9a, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ed156-8d73-4818-9ee1-d761cf04bf66]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:49 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 Jul 06 12:26:49 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:50 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12" returned: 0 in 0.944s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:26:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:26:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:26:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca87a123-810b-4daf-87b2-73a65501a61e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:50 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:26:50 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Flow 'volume_create_manager' (303b0248-9f32-445a-bca9-8cfa6efe3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507fe67a-f312-4f48-b3f9-aec38ecc1084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507fe67a-f312-4f48-b3f9-aec38ecc1084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1106899227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b60f03-cb84-4007-bd11-89c235ceb963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97b25e2fc9441b49e5f0263c48849dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:51Z,use_quota=True,user_id='25e95d862e0b4b7d8c8a38960dcca1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79ce724-e391-4efd-b84d-2ed2ae049a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79ce724-e391-4efd-b84d-2ed2ae049a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3556f4dc-54fe-43e9-8152-b0887d9c074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3556f4dc-54fe-43e9-8152-b0887d9c074b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b60f03-cb84-4007-bd11-89c235ceb963', 'volume_name': 'volume-50b60f03-cb84-4007-bd11-89c235ceb963', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cac7ba-0a0a-4791-9ebf-b577eefd74ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cac7ba-0a0a-4791-9ebf-b577eefd74ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (becd779e-15be-4750-8837-d9dd49b315cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Volume 50b60f03-cb84-4007-bd11-89c235ceb963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b60f03-cb84-4007-bd11-89c235ceb963', 'volume_size': 1} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:51 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 1.092s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:26:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:51 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a Jul 06 12:26:51 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:56 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a" returned: 0 in 5.087s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dad6d49-1cbb-44ed-bc11-69709ad12593]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:56 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:26:56 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:57 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 1.027s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:57 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:26:57 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Converted 1024.00 MB image at 201.17 MB/s Jul 06 12:26:57 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a is being set with open permissions: ugo+rw Jul 06 12:26:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:57 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a Jul 06 12:26:57 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:58 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-7f089b5f-b603-4848-8f22-f6079b2abb9a" released by "_copy_volume_from_snapshot" :: held 9.070s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-db4004bb-d9f4-43b5-a78f-50684ad06e12-7f089b5f-b603-4848-8f22-f6079b2abb9a" released by "_create_volume_from_snapshot" :: held 9.121s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.140s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.147s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1106899227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b60f03-cb84-4007-bd11-89c235ceb963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97b25e2fc9441b49e5f0263c48849dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:51Z,use_quota=True,user_id='25e95d862e0b4b7d8c8a38960dcca1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Creating volume 50b60f03-cb84-4007-bd11-89c235ceb963 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:58 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:58 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 1073741824 Jul 06 12:26:58 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc06ccc1-50e9-4fae-b8fd-1789c8a1c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f089b5f-b603-4848-8f22-f6079b2abb9a', 'volume_size': 1, 'snapshot_id': 'db4004bb-d9f4-43b5-a78f-50684ad06e12'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa93408-f6cb-478b-b553-437c46c58267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:58 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Volume volume-7f089b5f-b603-4848-8f22-f6079b2abb9a (7f089b5f-b603-4848-8f22-f6079b2abb9a): created successfully Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa93408-f6cb-478b-b553-437c46c58267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Flow 'volume_create_manager' (2ef852ef-171c-423b-9404-6e04bf6a5701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4f5ee106-79ef-4084-b162-7919061adf10 tempest-TestStampPattern-778066226 None] Created volume successfully. Jul 06 12:26:59 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 1073741824" returned: 0 in 0.954s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:59 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 Jul 06 12:26:59 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:00 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963" returned: 0 in 0.766s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:27:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (becd779e-15be-4750-8837-d9dd49b315cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b60f03-cb84-4007-bd11-89c235ceb963', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21097e49-fcd6-4bc2-978b-49b8d1469f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:00 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Volume volume-50b60f03-cb84-4007-bd11-89c235ceb963 (50b60f03-cb84-4007-bd11-89c235ceb963): created successfully Jul 06 12:27:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21097e49-fcd6-4bc2-978b-49b8d1469f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Flow 'volume_create_manager' (303b0248-9f32-445a-bca9-8cfa6efe3910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8ec06163-80bb-4d18-b0fa-68a849e089a6 tempest-VolumeQuotasAdminTestJSON-677486308 None] Created volume successfully. Jul 06 12:27:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Acquiring lock "cinder-50b60f03-cb84-4007-bd11-89c235ceb963-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "cinder-50b60f03-cb84-4007-bd11-89c235ceb963-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Acquiring lock "cinder-quobyte-50b60f03-cb84-4007-bd11-89c235ceb963" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "cinder-quobyte-50b60f03-cb84-4007-bd11-89c235ceb963" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:01 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[514ba3cd-6bcf-49c4-ab1b-2c46fff95e3b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:01 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 Jul 06 12:27:01 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:02 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963" returned: 0 in 0.836s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:02 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963 Jul 06 12:27:02 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:03 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-50b60f03-cb84-4007-bd11-89c235ceb963" returned: 0 in 0.794s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "cinder-quobyte-50b60f03-cb84-4007-bd11-89c235ceb963" released by "delete_volume" :: held 1.700s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Created reservations ['70ae918d-34ba-489e-ba39-2c029af99370', '65395afb-fa45-41bd-b64f-e8f00d97bc52', 'a1cf1408-948c-450a-8012-a1c7de754094', '01dce31d-e103-41b1-a420-0067fe9029ae'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:03 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:27:03 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:04 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.790s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:04 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Deleted volume successfully. Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ad50f48f-c976-4cf1-a4a5-c0c7ce3464df tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "cinder-50b60f03-cb84-4007-bd11-89c235ceb963-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Flow 'volume_create_manager' (ff337ef3-4224-4ba1-a5d5-08d687549726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2829ec7-3952-4eea-ad55-466e474a9bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2829ec7-3952-4eea-ad55-466e474a9bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2086132662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04633c1d-5da8-4fcd-9c6b-bfe71298a5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97b25e2fc9441b49e5f0263c48849dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:04Z,use_quota=True,user_id='25e95d862e0b4b7d8c8a38960dcca1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dd8d8b-f9e0-4e0a-aa6e-4a8e6e61a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dd8d8b-f9e0-4e0a-aa6e-4a8e6e61a146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27e204e-0757-4f0b-897b-4afd39204b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27e204e-0757-4f0b-897b-4afd39204b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04633c1d-5da8-4fcd-9c6b-bfe71298a5f9', 'volume_name': 'volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665f9f09-4086-4399-be05-c92fda690455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665f9f09-4086-4399-be05-c92fda690455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5beb21f-90a7-4102-aead-b8314f1671dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Volume 04633c1d-5da8-4fcd-9c6b-bfe71298a5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9', 'volume_size': 1} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2086132662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04633c1d-5da8-4fcd-9c6b-bfe71298a5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97b25e2fc9441b49e5f0263c48849dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:04Z,use_quota=True,user_id='25e95d862e0b4b7d8c8a38960dcca1c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Creating volume 04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:27:04 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:27:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:04 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 1073741824 Jul 06 12:27:04 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:05 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 1073741824" returned: 0 in 1.115s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:05 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 Jul 06 12:27:05 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:06 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9" returned: 0 in 0.669s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:27:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5beb21f-90a7-4102-aead-b8314f1671dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0409bd-8efb-4034-9189-1e51863f51e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:06 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Volume volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 (04633c1d-5da8-4fcd-9c6b-bfe71298a5f9): created successfully Jul 06 12:27:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0409bd-8efb-4034-9189-1e51863f51e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:06 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Flow 'volume_create_manager' (ff337ef3-4224-4ba1-a5d5-08d687549726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7b62692d-6b50-44cb-9557-9100a532f6bb tempest-VolumeQuotasAdminTestJSON-677486308 None] Created volume successfully. Jul 06 12:27:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fb637cc5-705a-4a47-bebb-8aa9aff627ad tempest-VolumeQuotasAdminTestJSON-408960875 None] Transfer volume completed successfully. Jul 06 12:27:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Acquiring lock "cinder-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Lock "cinder-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Acquiring lock "cinder-quobyte-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Lock "cinder-quobyte-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[475c0524-a34f-4e07-a179-71c2685c6372]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:08 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 Jul 06 12:27:08 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:09 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9" returned: 0 in 0.908s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:09 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9 Jul 06 12:27:09 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:10 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9" returned: 0 in 0.868s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Lock "cinder-quobyte-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9" released by "delete_volume" :: held 1.830s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Created reservations ['950edfc7-325b-4501-afb0-2c29fba44643', '6d380f45-21ef-4e4e-9ecc-2638c0db9763', 'cb8de29b-f9cf-49f5-81a9-78fdfd5a4c06', 'cf442c47-87ff-4f6c-88db-74477fe920e0'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:10 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:27:10 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:11 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.892s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:11 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Deleted volume successfully. Jul 06 12:27:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-558bd10d-fb07-46d5-8b4e-417e17d75610 tempest-VolumeQuotasAdminTestJSON-40677255 None] Lock "cinder-04633c1d-5da8-4fcd-9c6b-bfe71298a5f9-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Flow 'volume_create_manager' (adfdf619-8a63-4fa0-8e90-53ad4828fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf17466-6999-4e23-bfd7-29e6317ef604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf17466-6999-4e23-bfd7-29e6317ef604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1229918263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802b0184-6a73-42e8-875a-aef3317faff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d41cc922dc24bc4b12b6379ce4212a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:20Z,use_quota=True,user_id='9e1b899870c54fd695a4e7b73b4cfb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc658422-84bb-4090-b347-5548ffc8d335),volume_type_id=dc658422-84bb-4090-b347-5548ffc8d335)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f939cb-30d0-4911-b4fe-57a29df344c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f939cb-30d0-4911-b4fe-57a29df344c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c39b23-ae04-44d8-88a0-6be276c44e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c39b23-ae04-44d8-88a0-6be276c44e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802b0184-6a73-42e8-875a-aef3317faff5', 'volume_name': 'volume-802b0184-6a73-42e8-875a-aef3317faff5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaca94f-5c79-4feb-b145-baba5ebfe2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaca94f-5c79-4feb-b145-baba5ebfe2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5257f48-1bb3-4aad-954a-9d56b65c3805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:19 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Volume 802b0184-6a73-42e8-875a-aef3317faff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802b0184-6a73-42e8-875a-aef3317faff5', 'volume_size': 1} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1229918263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802b0184-6a73-42e8-875a-aef3317faff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d41cc922dc24bc4b12b6379ce4212a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:20Z,use_quota=True,user_id='9e1b899870c54fd695a4e7b73b4cfb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc658422-84bb-4090-b347-5548ffc8d335),volume_type_id=dc658422-84bb-4090-b347-5548ffc8d335)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Creating volume 802b0184-6a73-42e8-875a-aef3317faff5 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:27:19 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:27:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:19 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 1073741824 Jul 06 12:27:19 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:20 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 1073741824" returned: 0 in 1.021s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:20 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 Jul 06 12:27:20 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:21 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5" returned: 0 in 0.716s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5257f48-1bb3-4aad-954a-9d56b65c3805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802b0184-6a73-42e8-875a-aef3317faff5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c600c35-4573-43a6-978c-4bce5ea0a5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:21 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Volume volume-802b0184-6a73-42e8-875a-aef3317faff5 (802b0184-6a73-42e8-875a-aef3317faff5): created successfully Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c600c35-4573-43a6-978c-4bce5ea0a5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Flow 'volume_create_manager' (adfdf619-8a63-4fa0-8e90-53ad4828fab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:21 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-565b01ef-17bf-443d-a4b2-b25551835ad9 tempest-VolumeTypesAccessTest-589278281 None] Created volume successfully. Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Acquiring lock "cinder-802b0184-6a73-42e8-875a-aef3317faff5-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Lock "cinder-802b0184-6a73-42e8-875a-aef3317faff5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Acquiring lock "cinder-quobyte-802b0184-6a73-42e8-875a-aef3317faff5" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Lock "cinder-quobyte-802b0184-6a73-42e8-875a-aef3317faff5" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9ccd5c-10dd-4dae-965a-4339b5dcb83c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:21 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 Jul 06 12:27:21 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:22 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5" returned: 0 in 0.826s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:22 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5 Jul 06 12:27:22 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:23 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-802b0184-6a73-42e8-875a-aef3317faff5" returned: 0 in 0.701s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Lock "cinder-quobyte-802b0184-6a73-42e8-875a-aef3317faff5" released by "delete_volume" :: held 1.569s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:23 devstack cinder-volume[86706]: WARNING cinder.quota [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-598275648 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-598275648, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:27:23 devstack cinder-volume[86706]: WARNING cinder.quota [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-598275648 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-598275648, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Created reservations ['7d36f578-feda-4b68-b137-b5223e423a8c', '7a7231d0-4136-4a93-9089-69ad247ca6d1', '3c34416d-4e76-484f-89f4-b8249903d02a', 'b6fa8815-a0b9-4f6c-bb25-ccdf01ef7818'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:23 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:27:23 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:24 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.728s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:24 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:24 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Deleted volume successfully. Jul 06 12:27:24 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d11a41a9-7825-410b-a688-0d2bec5412eb tempest-VolumeTypesAccessTest-589278281 None] Lock "cinder-802b0184-6a73-42e8-875a-aef3317faff5-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:27 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:27:27 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:27 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.713s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:27:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:27:33 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=34,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:34 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=25,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6b4fba2a-d260-40e6-b7a0-aec5236133f4 req-6b0edaa7-f21a-4cc9-94e3-fe52b5c7f7d6 tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6b4fba2a-d260-40e6-b7a0-aec5236133f4 req-6b0edaa7-f21a-4cc9-94e3-fe52b5c7f7d6 tempest-TestStampPattern-778066226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:37 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc6b7d0-e0b4-439c-9d76-f4b640994801]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6b4fba2a-d260-40e6-b7a0-aec5236133f4 req-6b0edaa7-f21a-4cc9-94e3-fe52b5c7f7d6 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:37 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a Jul 06 12:27:37 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:38 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-6b4fba2a-d260-40e6-b7a0-aec5236133f4 req-6b0edaa7-f21a-4cc9-94e3-fe52b5c7f7d6 tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a" returned: 0 in 0.818s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-6b4fba2a-d260-40e6-b7a0-aec5236133f4 req-6b0edaa7-f21a-4cc9-94e3-fe52b5c7f7d6 tempest-TestStampPattern-778066226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-6b4fba2a-d260-40e6-b7a0-aec5236133f4 req-6b0edaa7-f21a-4cc9-94e3-fe52b5c7f7d6 tempest-TestStampPattern-778066226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-7f089b5f-b603-4848-8f22-f6079b2abb9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5c8e16c-f717-4393-9984-521e2c9f9828', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:27:38 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-6b4fba2a-d260-40e6-b7a0-aec5236133f4 req-6b0edaa7-f21a-4cc9-94e3-fe52b5c7f7d6 tempest-TestStampPattern-778066226 None] attachment_update completed successfully. Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Flow 'volume_create_manager' (01a3323b-ee92-4a66-89d8-802026ffc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e10c830-1a49-4122-983a-0700ac0a4770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e10c830-1a49-4122-983a-0700ac0a4770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1789181640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf588f2-765e-4eeb-8118-330dce98de94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffbca9f90744c0285d9ab4cb37710da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:40Z,use_quota=True,user_id='959d12961116451583c62958f6c57a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c41bb0b-ce4c-4f5c-98c6-edf0d7dcba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c41bb0b-ce4c-4f5c-98c6-edf0d7dcba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54509f-62fe-4dad-a109-5b50fbfd64ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54509f-62fe-4dad-a109-5b50fbfd64ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf588f2-765e-4eeb-8118-330dce98de94', 'volume_name': 'volume-0bf588f2-765e-4eeb-8118-330dce98de94', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c2cb89-1316-4e8b-956b-b55fc9927ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c2cb89-1316-4e8b-956b-b55fc9927ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba3d9f4-4bbc-481f-9e7c-60a286f88f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:40 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Volume 0bf588f2-765e-4eeb-8118-330dce98de94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf588f2-765e-4eeb-8118-330dce98de94', 'volume_size': 1} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1789181640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf588f2-765e-4eeb-8118-330dce98de94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffbca9f90744c0285d9ab4cb37710da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:40Z,use_quota=True,user_id='959d12961116451583c62958f6c57a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Creating volume 0bf588f2-765e-4eeb-8118-330dce98de94 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:27:40 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:27:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:40 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 1073741824 Jul 06 12:27:40 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:41 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 1073741824" returned: 0 in 0.907s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:41 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 Jul 06 12:27:41 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:42 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94" returned: 0 in 0.711s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:27:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba3d9f4-4bbc-481f-9e7c-60a286f88f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf588f2-765e-4eeb-8118-330dce98de94', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec014c02-7d89-4fc6-9b79-e83c67f865f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:42 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Volume volume-0bf588f2-765e-4eeb-8118-330dce98de94 (0bf588f2-765e-4eeb-8118-330dce98de94): created successfully Jul 06 12:27:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec014c02-7d89-4fc6-9b79-e83c67f865f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Flow 'volume_create_manager' (01a3323b-ee92-4a66-89d8-802026ffc856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a1660327-cf27-45eb-9c91-5741c6610e3b tempest-VolumesTransfersV357Test-776288064 None] Created volume successfully. Jul 06 12:27:43 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a33f612c-be99-460f-956c-0907b6a1e98d tempest-VolumesTransfersV357Test-1015886757 None] Transfer volume completed successfully. Jul 06 12:27:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Acquiring lock "cinder-0bf588f2-765e-4eeb-8118-330dce98de94-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-0bf588f2-765e-4eeb-8118-330dce98de94-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Acquiring lock "cinder-quobyte-0bf588f2-765e-4eeb-8118-330dce98de94" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-quobyte-0bf588f2-765e-4eeb-8118-330dce98de94" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d449dff-1a1a-4c6b-bda9-6e5d7c5eed87]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:44 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 Jul 06 12:27:44 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:45 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94" returned: 0 in 0.758s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:45 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94 Jul 06 12:27:45 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-77086214-29b5-42cc-bf81-441fb09b1340 req-9cd40522-cd60-4905-a6e6-d3ad468f5910 tempest-TestStampPattern-778066226 None] Terminate volume connection completed successfully. Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-77086214-29b5-42cc-bf81-441fb09b1340 req-9cd40522-cd60-4905-a6e6-d3ad468f5910 tempest-TestStampPattern-778066226 None] Deleting attachment a5c8e16c-f717-4393-9984-521e2c9f9828. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:27:45 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0bf588f2-765e-4eeb-8118-330dce98de94" returned: 0 in 0.738s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-quobyte-0bf588f2-765e-4eeb-8118-330dce98de94" released by "delete_volume" :: held 1.533s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Created reservations ['a30f5d5c-6f86-4557-b586-991259bee40a', 'b5a6bc8e-cebf-406f-bcd0-7f08e852a2f3', '36fb247c-7782-4081-b9b3-cb93a7d42505', '07f0dad8-f84c-4396-bc47-b8fdd6434e72'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:45 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:27:45 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:46 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.756s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:46 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Deleted volume successfully. Jul 06 12:27:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f98d86a0-6931-4fdc-b281-8afe7ac640e9 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-0bf588f2-765e-4eeb-8118-330dce98de94-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Flow 'volume_create_manager' (a027e03f-4511-4c05-8b97-1da674588323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39504047-1a92-42f6-9768-3ce7112d7cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39504047-1a92-42f6-9768-3ce7112d7cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-310111511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a97454-d980-48b7-8ac3-f00ed45d4812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffbca9f90744c0285d9ab4cb37710da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:47Z,use_quota=True,user_id='959d12961116451583c62958f6c57a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96de9a8-3b2d-4ec8-851e-239e7df23241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96de9a8-3b2d-4ec8-851e-239e7df23241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77734c54-3b50-4b08-8f9b-6f1c234413fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77734c54-3b50-4b08-8f9b-6f1c234413fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a97454-d980-48b7-8ac3-f00ed45d4812', 'volume_name': 'volume-37a97454-d980-48b7-8ac3-f00ed45d4812', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98da325-1f88-45ef-a048-c38779787547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98da325-1f88-45ef-a048-c38779787547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0395ad12-b74a-443c-bfad-eb5838510e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:47 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Volume 37a97454-d980-48b7-8ac3-f00ed45d4812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a97454-d980-48b7-8ac3-f00ed45d4812', 'volume_size': 1} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-310111511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a97454-d980-48b7-8ac3-f00ed45d4812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffbca9f90744c0285d9ab4cb37710da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:47Z,use_quota=True,user_id='959d12961116451583c62958f6c57a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Creating volume 37a97454-d980-48b7-8ac3-f00ed45d4812 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:27:47 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:27:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:47 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 1073741824 Jul 06 12:27:47 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:48 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 1073741824" returned: 0 in 1.128s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:48 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 Jul 06 12:27:48 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:49 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812" returned: 0 in 0.866s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:27:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0395ad12-b74a-443c-bfad-eb5838510e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a97454-d980-48b7-8ac3-f00ed45d4812', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3991a1ca-9b7c-422f-bc5a-72790c6d94d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:49 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Volume volume-37a97454-d980-48b7-8ac3-f00ed45d4812 (37a97454-d980-48b7-8ac3-f00ed45d4812): created successfully Jul 06 12:27:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3991a1ca-9b7c-422f-bc5a-72790c6d94d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Flow 'volume_create_manager' (a027e03f-4511-4c05-8b97-1da674588323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ade013ef-4060-440c-9ab0-1789602ec98e tempest-VolumesTransfersV357Test-776288064 None] Created volume successfully. Jul 06 12:27:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Acquiring lock "cinder-37a97454-d980-48b7-8ac3-f00ed45d4812-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-37a97454-d980-48b7-8ac3-f00ed45d4812-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Acquiring lock "cinder-quobyte-37a97454-d980-48b7-8ac3-f00ed45d4812" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-quobyte-37a97454-d980-48b7-8ac3-f00ed45d4812" acquired by "delete_volume" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f4fdca-a837-4f99-89f7-0fc2b6912320]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:50 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 Jul 06 12:27:50 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:51 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812" returned: 0 in 0.901s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:51 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812 Jul 06 12:27:51 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:52 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a97454-d980-48b7-8ac3-f00ed45d4812" returned: 0 in 0.845s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-quobyte-37a97454-d980-48b7-8ac3-f00ed45d4812" released by "delete_volume" :: held 1.800s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Created reservations ['689a32fb-60a1-44a6-a8be-26d0574eada4', '31ad8fa4-3dfa-4644-80b5-f85f9af79a78', '3c77176a-5111-4c99-aec4-66beb350dcf0', '265f904b-eb49-4091-aaac-990f733eab3e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:52 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:27:52 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:53 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.784s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:53 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Deleted volume successfully. Jul 06 12:27:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-319d3e9d-0488-4cf5-a7bb-862524b74121 tempest-VolumesTransfersV357Test-548503880 None] Lock "cinder-37a97454-d980-48b7-8ac3-f00ed45d4812-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-7f089b5f-b603-4848-8f22-f6079b2abb9a-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Lock "cinder-7f089b5f-b603-4848-8f22-f6079b2abb9a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-quobyte-7f089b5f-b603-4848-8f22-f6079b2abb9a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-7f089b5f-b603-4848-8f22-f6079b2abb9a" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c28c47-1392-4ca5-9652-ba2d7862e3bb]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:56 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a Jul 06 12:27:56 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:57 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a" returned: 0 in 0.888s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:57 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a Jul 06 12:27:57 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:57 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f089b5f-b603-4848-8f22-f6079b2abb9a" returned: 0 in 0.699s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-7f089b5f-b603-4848-8f22-f6079b2abb9a" released by "delete_volume" :: held 1.644s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Created reservations ['325bdb55-c06c-4fc7-999f-6176062269f1', 'c8ca0882-e8ad-419e-8206-e8120ff1a5d1', '9ecf0f8c-bc80-4554-b1e9-d6541e34204b', 'c1f97ee4-e166-412e-a1e3-49743ad4b2b4'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:58 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:27:58 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:58 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.752s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Deleted volume successfully. Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a48119a-b820-45e1-b442-492c868f8a27 tempest-TestStampPattern-778066226 None] Lock "cinder-7f089b5f-b603-4848-8f22-f6079b2abb9a-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-db4004bb-d9f4-43b5-a78f-50684ad06e12-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Lock "cinder-db4004bb-d9f4-43b5-a78f-50684ad06e12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-quobyte-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-quobyte-db4004bb-d9f4-43b5-a78f-50684ad06e12" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-db4004bb-d9f4-43b5-a78f-50684ad06e12" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Deleting offline snapshot db4004bb-d9f4-43b5-a78f-50684ad06e12 of volume 70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] snapshot_file for this snap is: volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[da13cf5f-08a0-4560-a1e2-46649c6fdbc5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:59 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 Jul 06 12:27:59 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:59 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12" returned: 0 in 0.917s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9249db1-f4c9-45aa-908d-9719607e0bf6]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:00 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:28:00 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:00 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 0.921s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:00 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 Jul 06 12:28:00 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:01 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12" returned: 0 in 0.920s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:01 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12 Jul 06 12:28:01 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:02 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5.db4004bb-d9f4-43b5-a78f-50684ad06e12" returned: 0 in 0.727s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-db4004bb-d9f4-43b5-a78f-50684ad06e12" released by "_delete_snapshot" :: held 3.614s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" released by "delete_snapshot" :: held 3.649s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:02 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Created reservations ['591c8f59-5a87-416a-9148-cc6cd376af71', '396c3e05-0bd3-4950-be60-37f5bbae7dc8', 'f64583a5-7802-4e7c-b17e-3c4f7237b025', '5ee8adbc-ce7c-4475-927c-3215e73a365a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Delete snapshot completed successfully. Jul 06 12:28:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-57496813-7c4f-4c98-a88d-88ed4bb77a5e tempest-TestStampPattern-778066226 None] Lock "cinder-db4004bb-d9f4-43b5-a78f-50684ad06e12-delete_snapshot" released by "delete_snapshot" :: held 3.890s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Lock "cinder-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Acquiring lock "cinder-quobyte-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:11 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6419fab3-f805-4fc7-aa8d-7b11b693a7f4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:11 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:28:11 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:12 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 0.911s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:12 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5 Jul 06 12:28:12 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:13 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" returned: 0 in 0.799s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Lock "cinder-quobyte-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5" released by "delete_volume" :: held 1.796s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Created reservations ['f8d979c6-fb88-4d45-ac45-f509c9a00f6a', '5bf02491-11f2-4176-9334-7c3c60ee712b', '2f90910d-6f3b-4b95-a8e7-5f75509939b5', 'cea34b06-4c09-4d9c-805f-fc51b0ef6ac2'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:13 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:28:13 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:14 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.929s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:14 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Deleted volume successfully. Jul 06 12:28:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a955b381-93db-4ff4-94b0-585237aa4bea tempest-TestStampPattern-778066226 None] Lock "cinder-70d111c3-16b2-4a45-a7dc-ea5fd9c3f4c5-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:23 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=36,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:24 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=42,cinder:SELECT=38,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:27 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:28:27 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:27 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.862s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:28:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (5e808112-b7bb-419c-8630-0dbca61490ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a69a9b-850d-49c3-98c3-9409c805e373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a69a9b-850d-49c3-98c3-9409c805e373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930354053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c689a3ce-0758-4227-a7b6-693167b73187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:30Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10816614-6b7d-470c-9b76-e7a88d800924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10816614-6b7d-470c-9b76-e7a88d800924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e50a24d-3441-46eb-b7e9-df2fe65e5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e50a24d-3441-46eb-b7e9-df2fe65e5a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c689a3ce-0758-4227-a7b6-693167b73187', 'volume_name': 'volume-c689a3ce-0758-4227-a7b6-693167b73187', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a8ce70-0fdb-485a-b4f5-7db05e76b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a8ce70-0fdb-485a-b4f5-7db05e76b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cab96c-3942-43eb-93d7-886138e67a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Volume c689a3ce-0758-4227-a7b6-693167b73187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c689a3ce-0758-4227-a7b6-693167b73187', 'volume_size': 1} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930354053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c689a3ce-0758-4227-a7b6-693167b73187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:30Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Creating volume c689a3ce-0758-4227-a7b6-693167b73187 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:30 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:30 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 1073741824 Jul 06 12:28:30 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (07e9a8f9-8a1d-444b-81d7-2bd08ceeaa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c649ce-c618-43c6-b39e-2bf727237591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c649ce-c618-43c6-b39e-2bf727237591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-414343530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70af9d7b-acbb-45f5-828b-679be2b97f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:31Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ea1ae7-6313-4b35-b380-130b0122443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ea1ae7-6313-4b35-b380-130b0122443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091f9f7d-b5c2-48aa-88ef-4a79e41692ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091f9f7d-b5c2-48aa-88ef-4a79e41692ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70af9d7b-acbb-45f5-828b-679be2b97f36', 'volume_name': 'volume-70af9d7b-acbb-45f5-828b-679be2b97f36', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf22ab4-ebab-4116-bbb8-64a963871d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf22ab4-ebab-4116-bbb8-64a963871d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2095309c-451f-4fef-a5f7-534327ed64c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Volume 70af9d7b-acbb-45f5-828b-679be2b97f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70af9d7b-acbb-45f5-828b-679be2b97f36', 'volume_size': 1} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (4dbb0bff-751b-4b47-8aae-5cf618b8a873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdb5559-c04b-4c59-a085-3f9e55b80aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdb5559-c04b-4c59-a085-3f9e55b80aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769898600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:31Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad102d7d-44a0-4847-9419-24be66442b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad102d7d-44a0-4847-9419-24be66442b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d164cd-6054-4007-9974-9ee1b757bb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d164cd-6054-4007-9974-9ee1b757bb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c', 'volume_name': 'volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de739182-82e8-46ee-863c-78cd369a227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de739182-82e8-46ee-863c-78cd369a227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d59a85-cd97-42d1-9c77-de63846a321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Volume 1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c', 'volume_size': 1} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:31 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 1073741824" returned: 0 in 1.069s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:31 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 Jul 06 12:28:31 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (a37574af-0b47-493a-b579-89162e5f78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acdb43d-ec7b-4eca-850c-0a95fc632d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acdb43d-ec7b-4eca-850c-0a95fc632d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-719378229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d30a426-5a4e-4981-8f7b-393e61d513bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:32Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8323b42-5e84-4981-90ca-50cd764bea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8323b42-5e84-4981-90ca-50cd764bea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475db775-ec6c-4783-b37d-e365cec07b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475db775-ec6c-4783-b37d-e365cec07b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d30a426-5a4e-4981-8f7b-393e61d513bc', 'volume_name': 'volume-9d30a426-5a4e-4981-8f7b-393e61d513bc', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71057516-fc81-4d0b-a8a6-300f800f86fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71057516-fc81-4d0b-a8a6-300f800f86fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d5239d-1204-4243-a7b5-b010568e9b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Volume 9d30a426-5a4e-4981-8f7b-393e61d513bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d30a426-5a4e-4981-8f7b-393e61d513bc', 'volume_size': 1} Jul 06 12:28:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (9d96cd98-9232-4fc7-9d05-15da2b0cb445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44b03ab-75ec-4807-af15-4350926bcd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44b03ab-75ec-4807-af15-4350926bcd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162941272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8617e8ad-90d9-4d6d-8010-1ef1c710ae4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:32Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88dad75f-51b7-4133-b7ac-f312855f5129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88dad75f-51b7-4133-b7ac-f312855f5129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ef9009-a765-4f22-865a-a2731e713731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ef9009-a765-4f22-865a-a2731e713731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8617e8ad-90d9-4d6d-8010-1ef1c710ae4f', 'volume_name': 'volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9555d59-bfef-42c9-96c9-e4d8e121057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9555d59-bfef-42c9-96c9-e4d8e121057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5641962-86d9-42cf-9a66-d7113b21e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Volume 8617e8ad-90d9-4d6d-8010-1ef1c710ae4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f', 'volume_size': 1} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:32 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187" returned: 0 in 0.876s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-414343530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70af9d7b-acbb-45f5-828b-679be2b97f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:31Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Creating volume 70af9d7b-acbb-45f5-828b-679be2b97f36 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:32 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cab96c-3942-43eb-93d7-886138e67a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c689a3ce-0758-4227-a7b6-693167b73187', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:32 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 1073741824 Jul 06 12:28:32 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0668fe-881f-424e-b8cb-f73423ef97e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Volume volume-c689a3ce-0758-4227-a7b6-693167b73187 (c689a3ce-0758-4227-a7b6-693167b73187): created successfully Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0668fe-881f-424e-b8cb-f73423ef97e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (5e808112-b7bb-419c-8630-0dbca61490ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:32 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ff37e642-1132-4e1d-bd73-544e589b5312 tempest-CreateVolumesFromImageTest-621498708 None] Created volume successfully. Jul 06 12:28:33 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 1073741824" returned: 0 in 1.002s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:33 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 Jul 06 12:28:33 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:34 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36" returned: 0 in 0.754s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769898600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:31Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Creating volume 1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:34 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2095309c-451f-4fef-a5f7-534327ed64c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70af9d7b-acbb-45f5-828b-679be2b97f36', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:34 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c 1073741824 Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d22de6-1794-4640-9dea-d10699a9207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:34 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Volume volume-70af9d7b-acbb-45f5-828b-679be2b97f36 (70af9d7b-acbb-45f5-828b-679be2b97f36): created successfully Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d22de6-1794-4640-9dea-d10699a9207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (07e9a8f9-8a1d-444b-81d7-2bd08ceeaa76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7e04b039-35cd-48b8-b0ec-64c73c165978 tempest-CreateVolumesFromImageTest-621498708 None] Created volume successfully. Jul 06 12:28:35 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c 1073741824" returned: 0 in 0.915s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:35 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c Jul 06 12:28:35 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:35 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c" returned: 0 in 0.683s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.177s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-719378229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d30a426-5a4e-4981-8f7b-393e61d513bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:32Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Creating volume 9d30a426-5a4e-4981-8f7b-393e61d513bc {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:36 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:36 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc 1073741824 Jul 06 12:28:36 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d59a85-cd97-42d1-9c77-de63846a321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360eafe2-c37e-4f3a-92d2-7adbe680b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Volume volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c (1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c): created successfully Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360eafe2-c37e-4f3a-92d2-7adbe680b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (4dbb0bff-751b-4b47-8aae-5cf618b8a873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-04691958-29f9-4fdf-8fc0-e4b9896a52a4 tempest-CreateVolumesFromImageTest-621498708 None] Created volume successfully. Jul 06 12:28:36 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc 1073741824" returned: 0 in 0.882s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:36 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc Jul 06 12:28:36 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:37 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc" returned: 0 in 0.804s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.484s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162941272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8617e8ad-90d9-4d6d-8010-1ef1c710ae4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9af6d1ccd9c4d5cb17c797e88107db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:32Z,use_quota=True,user_id='e19f056cf23a41de9c993ef656641725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Creating volume 8617e8ad-90d9-4d6d-8010-1ef1c710ae4f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:37 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:37 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f 1073741824 Jul 06 12:28:37 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d5239d-1204-4243-a7b5-b010568e9b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d30a426-5a4e-4981-8f7b-393e61d513bc', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d520a4aa-852e-439e-8eda-bdca19254cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:37 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Volume volume-9d30a426-5a4e-4981-8f7b-393e61d513bc (9d30a426-5a4e-4981-8f7b-393e61d513bc): created successfully Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d520a4aa-852e-439e-8eda-bdca19254cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (a37574af-0b47-493a-b579-89162e5f78c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a7dd5605-44a6-4716-905f-e43ed5697190 tempest-CreateVolumesFromImageTest-621498708 None] Created volume successfully. Jul 06 12:28:38 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f 1073741824" returned: 0 in 1.131s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:38 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f Jul 06 12:28:38 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:39 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f" returned: 0 in 0.780s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5641962-86d9-42cf-9a66-d7113b21e172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321e66aa-555a-40fc-a7d3-729ac3182efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:39 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Volume volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f (8617e8ad-90d9-4d6d-8010-1ef1c710ae4f): created successfully Jul 06 12:28:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321e66aa-555a-40fc-a7d3-729ac3182efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Flow 'volume_create_manager' (9d96cd98-9232-4fc7-9d05-15da2b0cb445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cefd9edd-e714-46ed-85e1-68ca547617ae tempest-CreateVolumesFromImageTest-621498708 None] Created volume successfully. Jul 06 12:28:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-quobyte-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:40 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea75c32-db03-465f-8c82-ab22c13f3cc2]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:40 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f Jul 06 12:28:40 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:40 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f" returned: 0 in 0.827s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:41 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f Jul 06 12:28:41 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:41 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f" returned: 0 in 0.780s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f" released by "delete_volume" :: held 1.667s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Created reservations ['e6c8d015-2f10-4e28-a3fb-c29142c016ba', 'ac038470-e29f-487e-ab04-0896f3aba613', '829be1ea-dbaf-4ff7-912f-2f5bc66f3937', '10c428bd-f237-419c-a11d-159714209e8d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:41 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:28:41 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-9d30a426-5a4e-4981-8f7b-393e61d513bc-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-9d30a426-5a4e-4981-8f7b-393e61d513bc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-quobyte-9d30a426-5a4e-4981-8f7b-393e61d513bc" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-9d30a426-5a4e-4981-8f7b-393e61d513bc" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[17529185-b2b3-4129-ab88-aa99748a4e72]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:42 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc Jul 06 12:28:42 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:42 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.978s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Deleted volume successfully. Jul 06 12:28:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7398ae3c-6d8c-4841-9d70-f69ee5f436e1 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-8617e8ad-90d9-4d6d-8010-1ef1c710ae4f-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:43 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc" returned: 0 in 1.101s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:43 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc Jul 06 12:28:43 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:44 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-9d30a426-5a4e-4981-8f7b-393e61d513bc" returned: 0 in 0.941s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-9d30a426-5a4e-4981-8f7b-393e61d513bc" released by "delete_volume" :: held 2.114s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Created reservations ['836af288-a52b-4f9a-aae7-3e41be6704d1', '1d489cc6-11d1-4095-b653-7922f3d97eee', '0b016da7-baf8-4865-92ff-3abe6c929cd4', '0ecac409-5999-4612-8a6e-efeba2f1a17b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:44 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:28:44 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:45 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.831s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Deleted volume successfully. Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-38c1b06d-a906-4022-984e-e8eaeb9e6042 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-9d30a426-5a4e-4981-8f7b-393e61d513bc-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-quobyte-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc18008e-b70b-4c1e-b006-332f28b28188]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:46 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c Jul 06 12:28:46 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:46 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c" returned: 0 in 0.891s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:46 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c Jul 06 12:28:46 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:47 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c" returned: 0 in 0.770s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c" released by "delete_volume" :: held 1.714s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Created reservations ['76a2bd51-90d1-407b-bca1-47eed895d461', 'bb1928f7-5406-4397-8af5-16d667f017e6', 'ac9cf684-a5a2-451c-91cf-4473eae9b6bf', '25d0fa3a-1971-42ca-8a21-7982b86553af'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:47 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:28:47 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-70af9d7b-acbb-45f5-828b-679be2b97f36-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-70af9d7b-acbb-45f5-828b-679be2b97f36-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-quobyte-70af9d7b-acbb-45f5-828b-679be2b97f36" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-70af9d7b-acbb-45f5-828b-679be2b97f36" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab9658-2d52-48aa-9d3a-5b93dd048394]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:48 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 Jul 06 12:28:48 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:48 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.788s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Deleted volume successfully. Jul 06 12:28:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99a749f7-a2e9-4bd5-acae-6ca4a3bed44c tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-1b4560b1-4d9d-48e2-a2f8-4222b2c3a45c-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:49 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36" returned: 0 in 0.897s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:49 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36 Jul 06 12:28:49 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:49 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-70af9d7b-acbb-45f5-828b-679be2b97f36" returned: 0 in 0.701s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-70af9d7b-acbb-45f5-828b-679be2b97f36" released by "delete_volume" :: held 1.648s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:49 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Created reservations ['1b9233d6-a1c6-443b-b9fe-98d09cdaf70c', 'a49559e7-7529-4207-939c-4cfd8981ccdb', '1a3ac1de-4665-412b-abc1-30b13a0314a9', '90561951-ab03-4e30-980d-929eb247a5b4'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:50 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:28:50 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-c689a3ce-0758-4227-a7b6-693167b73187-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-c689a3ce-0758-4227-a7b6-693167b73187-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "cinder-quobyte-c689a3ce-0758-4227-a7b6-693167b73187" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-c689a3ce-0758-4227-a7b6-693167b73187" acquired by "delete_volume" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68d6138-25e4-4880-92bc-6a8efa626cf1]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:50 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 Jul 06 12:28:50 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:50 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.772s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Deleted volume successfully. Jul 06 12:28:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9fe35e91-5c20-4c49-a936-6e979795f54d tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-70af9d7b-acbb-45f5-828b-679be2b97f36-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:51 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187" returned: 0 in 0.841s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:51 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187 Jul 06 12:28:51 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:52 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c689a3ce-0758-4227-a7b6-693167b73187" returned: 0 in 0.671s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-quobyte-c689a3ce-0758-4227-a7b6-693167b73187" released by "delete_volume" :: held 1.563s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Created reservations ['f906a625-0012-4afb-8b75-2eaebe3b341d', '54fa6082-10c0-4ab9-b56a-88073157bd2e', '94a9b2c5-7832-4786-898d-abc79c509df0', '21685e40-b43e-4133-948b-719d71a8b0e9'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:52 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:28:52 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:52 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.727s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:52 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:52 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Deleted volume successfully. Jul 06 12:28:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-26dd2291-fe82-412d-beaf-1914e6399f00 tempest-CreateVolumesFromImageTest-621498708 None] Lock "cinder-c689a3ce-0758-4227-a7b6-693167b73187-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Flow 'volume_create_manager' (a4b99936-a53f-4770-a3db-e4f89ffdeb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b14d0a5-746b-4e7e-9217-b5c0174480e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b14d0a5-746b-4e7e-9217-b5c0174480e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-146074326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c5838e-ae62-4583-9565-af34a05040c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85087276c0034510a63e4c45081d49fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:56Z,use_quota=True,user_id='fa714039702841628b5efef2bcf57308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8960c8a-83b8-4993-baf0-0190f4c3d766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8960c8a-83b8-4993-baf0-0190f4c3d766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce38fa4f-847b-47cc-b743-a23dd76d7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce38fa4f-847b-47cc-b743-a23dd76d7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c5838e-ae62-4583-9565-af34a05040c6', 'volume_name': 'volume-23c5838e-ae62-4583-9565-af34a05040c6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f34dd6-455a-4a2f-8a09-c1b47d762106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f34dd6-455a-4a2f-8a09-c1b47d762106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9c84e0-c447-4e9b-87a6-eae533ddd2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Volume 23c5838e-ae62-4583-9565-af34a05040c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c5838e-ae62-4583-9565-af34a05040c6', 'volume_size': 1} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-146074326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c5838e-ae62-4583-9565-af34a05040c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85087276c0034510a63e4c45081d49fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:56Z,use_quota=True,user_id='fa714039702841628b5efef2bcf57308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Creating volume 23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:56 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:28:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:56 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 1073741824 Jul 06 12:28:56 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:57 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 1073741824" returned: 0 in 0.848s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:57 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 Jul 06 12:28:57 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:57 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6" returned: 0 in 0.636s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9c84e0-c447-4e9b-87a6-eae533ddd2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c5838e-ae62-4583-9565-af34a05040c6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e474e7e-4c6a-4b56-b650-0ca9a8347cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Volume volume-23c5838e-ae62-4583-9565-af34a05040c6 (23c5838e-ae62-4583-9565-af34a05040c6): created successfully Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e474e7e-4c6a-4b56-b650-0ca9a8347cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Flow 'volume_create_manager' (a4b99936-a53f-4770-a3db-e4f89ffdeb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fa533ad7-cb82-4a55-b363-931f604fbdd2 tempest-VolumeDependencyTests-1844132497 None] Created volume successfully. Jul 06 12:28:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Creating offline snapshot 9c4612b0-f598-494e-a4a6-9f419e08f084 of volume 23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:28:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c68b7-0772-47d9-8384-491cbdff1ea3]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:58 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 Jul 06 12:28:58 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:59 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:59 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 1G Jul 06 12:28:59 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:00 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 1G" returned: 0 in 0.836s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c5838e-ae62-4583-9565-af34a05040c6 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:00 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c5838e-ae62-4583-9565-af34a05040c6 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 Jul 06 12:29:00 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:00 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c5838e-ae62-4583-9565-af34a05040c6 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084" returned: 0 in 0.704s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:00 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 is being set with open permissions: ugo+rw Jul 06 12:29:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:00 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 Jul 06 12:29:00 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:01 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084" returned: 0 in 0.675s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:01 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.info Jul 06 12:29:01 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:02 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.info" returned: 0 in 0.660s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:02 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.info is being set with open permissions: ugo+rw Jul 06 12:29:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:02 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.info Jul 06 12:29:02 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:02 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.info" returned: 0 in 0.645s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-331e26a7-b37d-4a44-9c4a-286a78810982 tempest-VolumeDependencyTests-1844132497 None] Create snapshot completed successfully Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Flow 'volume_create_manager' (96b1e777-a1e3-4bc5-b72c-3f7c4a994063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96173a5f-2f0a-401e-9ab4-02ed6eb3ae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96173a5f-2f0a-401e-9ab4-02ed6eb3ae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1028216895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956a3296-35a1-472f-99bc-c06487ff746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85087276c0034510a63e4c45081d49fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c4612b0-f598-494e-a4a6-9f419e08f084,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:04Z,use_quota=True,user_id='fa714039702841628b5efef2bcf57308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddbdb3-1536-4774-afc7-a1e57ec715bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddbdb3-1536-4774-afc7-a1e57ec715bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb0918c-f52e-421a-bfe5-15cb7e9e52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb0918c-f52e-421a-bfe5-15cb7e9e52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '956a3296-35a1-472f-99bc-c06487ff746b', 'volume_name': 'volume-956a3296-35a1-472f-99bc-c06487ff746b', 'volume_size': 1, 'snapshot_id': '9c4612b0-f598-494e-a4a6-9f419e08f084'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05529afb-605a-4b58-80d7-d5aa9d0b6b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05529afb-605a-4b58-80d7-d5aa9d0b6b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21d9bae-f6f2-4bf0-a8da-9e1fa453b827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Volume 956a3296-35a1-472f-99bc-c06487ff746b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-956a3296-35a1-472f-99bc-c06487ff746b', 'volume_size': 1, 'snapshot_id': '9c4612b0-f598-494e-a4a6-9f419e08f084'} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-quobyte-9c4612b0-f598-494e-a4a6-9f419e08f084-956a3296-35a1-472f-99bc-c06487ff746b" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-9c4612b0-f598-494e-a4a6-9f419e08f084-956a3296-35a1-472f-99bc-c06487ff746b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Creating volume 956a3296-35a1-472f-99bc-c06487ff746b from snapshot 9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-quobyte-956a3296-35a1-472f-99bc-c06487ff746b" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-956a3296-35a1-472f-99bc-c06487ff746b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] snapshot: 9c4612b0-f598-494e-a4a6-9f419e08f084, volume: 956a3296-35a1-472f-99bc-c06487ff746b, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2295cbce-d1d2-4550-8888-0f6d9a05cd7a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:04 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 Jul 06 12:29:04 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:05 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23c5838e-ae62-4583-9565-af34a05040c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Flow 'volume_create_manager' (2dc0a78a-12ae-42ad-9006-77f3276fdeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99240671-1948-4b9a-8faf-cb149c56391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3a6680-c372-49ff-b3e5-ddec8691f1f4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99240671-1948-4b9a-8faf-cb149c56391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2081729498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c85237-ef6a-4f7c-926e-7a3328689099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a78b9698014833aea85d7556624c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:05Z,use_quota=True,user_id='99bfed979c7a4334a3a64922462d57d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b117e9-506e-4e29-b698-1fe5550a8c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b117e9-506e-4e29-b698-1fe5550a8c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311c49e8-224e-4ec1-badf-ce75d138796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311c49e8-224e-4ec1-badf-ce75d138796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c85237-ef6a-4f7c-926e-7a3328689099', 'volume_name': 'volume-40c85237-ef6a-4f7c-926e-7a3328689099', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1224eee-7e7c-49c5-94e6-9fdff28b4cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1224eee-7e7c-49c5-94e6-9fdff28b4cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0941cdcb-db3b-4ada-9b37-10d5db7dd0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Volume 40c85237-ef6a-4f7c-926e-7a3328689099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c85237-ef6a-4f7c-926e-7a3328689099', 'volume_size': 1} Jul 06 12:29:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:05 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 Jul 06 12:29:05 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:06 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6" returned: 0 in 0.771s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:06 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:29:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:06 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b Jul 06 12:29:06 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:10 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b" returned: 0 in 4.523s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3f6055-3f7d-49bd-9eb2-c29b3dfef63e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:10 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 Jul 06 12:29:10 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:11 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6" returned: 0 in 0.904s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:11 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:29:11 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Converted 1024.00 MB image at 226.35 MB/s Jul 06 12:29:11 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b is being set with open permissions: ugo+rw Jul 06 12:29:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:11 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b Jul 06 12:29:11 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:12 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b" returned: 0 in 0.712s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-956a3296-35a1-472f-99bc-c06487ff746b" released by "_copy_volume_from_snapshot" :: held 7.920s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-9c4612b0-f598-494e-a4a6-9f419e08f084-956a3296-35a1-472f-99bc-c06487ff746b" released by "_create_volume_from_snapshot" :: held 7.949s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.964s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.881s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2081729498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c85237-ef6a-4f7c-926e-7a3328689099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a78b9698014833aea85d7556624c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:05Z,use_quota=True,user_id='99bfed979c7a4334a3a64922462d57d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Creating volume 40c85237-ef6a-4f7c-926e-7a3328689099 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:12 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:12 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 1073741824 Jul 06 12:29:12 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21d9bae-f6f2-4bf0-a8da-9e1fa453b827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956a3296-35a1-472f-99bc-c06487ff746b', 'volume_size': 1, 'snapshot_id': '9c4612b0-f598-494e-a4a6-9f419e08f084'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d12648-40ed-45e4-8430-e78a7b22597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:12 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Volume volume-956a3296-35a1-472f-99bc-c06487ff746b (956a3296-35a1-472f-99bc-c06487ff746b): created successfully Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d12648-40ed-45e4-8430-e78a7b22597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Flow 'volume_create_manager' (96b1e777-a1e3-4bc5-b72c-3f7c4a994063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e1c6eac8-6fb2-436d-9805-a8233033b15a tempest-VolumeDependencyTests-1844132497 None] Created volume successfully. Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-9c4612b0-f598-494e-a4a6-9f419e08f084-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-9c4612b0-f598-494e-a4a6-9f419e08f084-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-quobyte-23c5838e-ae62-4583-9565-af34a05040c6" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-23c5838e-ae62-4583-9565-af34a05040c6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-quobyte-9c4612b0-f598-494e-a4a6-9f419e08f084" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-9c4612b0-f598-494e-a4a6-9f419e08f084" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Deleting offline snapshot 9c4612b0-f598-494e-a4a6-9f419e08f084 of volume 23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] snapshot_file for this snap is: volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[14abc77f-1a4a-47af-a3a6-4a80c24919f9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:13 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 1073741824" returned: 0 in 0.931s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:13 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 Jul 06 12:29:13 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:13 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 Jul 06 12:29:13 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:13 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084" returned: 0 in 0.831s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23c5838e-ae62-4583-9565-af34a05040c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:29:13 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099" returned: 0 in 0.759s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[af53c1ee-c5a4-466b-9ea9-e1ed6fa71cd1]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0941cdcb-db3b-4ada-9b37-10d5db7dd0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c85237-ef6a-4f7c-926e-7a3328689099', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b99248-db94-4c5e-abec-e816683f39cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:13 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Volume volume-40c85237-ef6a-4f7c-926e-7a3328689099 (40c85237-ef6a-4f7c-926e-7a3328689099): created successfully Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b99248-db94-4c5e-abec-e816683f39cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Flow 'volume_create_manager' (2dc0a78a-12ae-42ad-9006-77f3276fdeed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3d5b398b-072f-4341-8504-1584cd5187e4 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Created volume successfully. Jul 06 12:29:14 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 Jul 06 12:29:14 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:14 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6" returned: 0 in 0.820s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:14 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 Jul 06 12:29:14 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:15 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084" returned: 0 in 0.855s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:15 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084 Jul 06 12:29:15 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:16 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6.9c4612b0-f598-494e-a4a6-9f419e08f084" returned: 0 in 0.680s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-9c4612b0-f598-494e-a4a6-9f419e08f084" released by "_delete_snapshot" :: held 3.297s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-23c5838e-ae62-4583-9565-af34a05040c6" released by "delete_snapshot" :: held 3.327s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:16 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Created reservations ['6c24ce03-1051-4d14-ab0d-a6339c40e8fe', '81bdc4fe-377e-4090-adf6-d5d1bd325792', '39acf32b-b268-4f81-aa72-63fe70d6c7cb', '3b016f8d-4b97-455b-9fa8-c8196ec05c18'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:16 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Delete snapshot completed successfully. Jul 06 12:29:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09fd4e9d-839a-4151-9d61-80048a625768 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-9c4612b0-f598-494e-a4a6-9f419e08f084-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-23c5838e-ae62-4583-9565-af34a05040c6-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-23c5838e-ae62-4583-9565-af34a05040c6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-quobyte-23c5838e-ae62-4583-9565-af34a05040c6" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-23c5838e-ae62-4583-9565-af34a05040c6" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:17 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae911a71-7724-48b2-a3df-d03d0eda101b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:17 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 Jul 06 12:29:17 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-e17b01c3-3396-40cf-be32-7e3e560ddffc req-b9baa24a-5c94-4429-8538-8f6fe9941864 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-e17b01c3-3396-40cf-be32-7e3e560ddffc req-b9baa24a-5c94-4429-8538-8f6fe9941864 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:18 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b45ac51-4307-43c7-af0a-ae1e0bf55333]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-e17b01c3-3396-40cf-be32-7e3e560ddffc req-b9baa24a-5c94-4429-8538-8f6fe9941864 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:18 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6" returned: 0 in 0.898s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:18 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6 Jul 06 12:29:18 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:18 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 Jul 06 12:29:18 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:19 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-23c5838e-ae62-4583-9565-af34a05040c6" returned: 0 in 0.742s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-23c5838e-ae62-4583-9565-af34a05040c6" released by "delete_volume" :: held 1.738s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:19 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [req-e17b01c3-3396-40cf-be32-7e3e560ddffc req-b9baa24a-5c94-4429-8538-8f6fe9941864 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099" returned: 0 in 0.877s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [req-e17b01c3-3396-40cf-be32-7e3e560ddffc req-b9baa24a-5c94-4429-8538-8f6fe9941864 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Created reservations ['0e733e7f-e36d-4eed-b49f-035d69f51f4e', 'd1d54a76-1075-410b-802f-a16d6deec441', 'fa6f6ba6-5069-4167-93f7-b9c2dd6c4d23', 'fdb685b3-10af-43b7-a9f9-26f59612b7d8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-e17b01c3-3396-40cf-be32-7e3e560ddffc req-b9baa24a-5c94-4429-8538-8f6fe9941864 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a', 'name': 'volume-40c85237-ef6a-4f7c-926e-7a3328689099', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b147bc7-a58b-437e-b3e1-caf934e4f666', 'enforce_multipath': True} {{(pid=86706) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:29:19 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-e17b01c3-3396-40cf-be32-7e3e560ddffc req-b9baa24a-5c94-4429-8538-8f6fe9941864 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] attachment_update completed successfully. Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:19 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:19 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-956a3296-35a1-472f-99bc-c06487ff746b-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-956a3296-35a1-472f-99bc-c06487ff746b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "cinder-quobyte-956a3296-35a1-472f-99bc-c06487ff746b" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-956a3296-35a1-472f-99bc-c06487ff746b" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[053be736-4877-4a48-b0ef-38e7ccbe06cc]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:19 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b Jul 06 12:29:19 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:20 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.844s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:20 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Deleted volume successfully. Jul 06 12:29:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fdea89af-d54a-41a0-af12-200437e3962a tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-23c5838e-ae62-4583-9565-af34a05040c6-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:20 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b" returned: 0 in 0.910s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:20 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b Jul 06 12:29:20 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:21 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-956a3296-35a1-472f-99bc-c06487ff746b" returned: 0 in 0.664s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-quobyte-956a3296-35a1-472f-99bc-c06487ff746b" released by "delete_volume" :: held 1.620s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Created reservations ['2b68d3d6-6154-4443-b720-5f44dd17ceab', 'cca9bd6c-d924-4e8f-8e71-5f387b0a0065', 'd61fd96a-357d-4833-aad5-b7651578708d', 'b43d2dff-8f50-4185-8fe4-baaf73361bc6'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:21 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:21 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:22 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.748s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:22 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Deleted volume successfully. Jul 06 12:29:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d6942579-99f8-458d-9e0e-b47cb8204255 tempest-VolumeDependencyTests-1844132497 None] Lock "cinder-956a3296-35a1-472f-99bc-c06487ff746b-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:26 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=85,cinder:SELECT=70,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:29:26 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=64,cinder:UPDATE=90,cinder:DELETE=11,cinder:INSERT=22 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:29:26 devstack cinder-volume[86706]: INFO cinder.volume.manager [req-a096a97a-ba6d-462d-bca5-5aca26504235 req-695fb34c-d984-490b-922e-746efd3903fc tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Terminate volume connection completed successfully. Jul 06 12:29:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [req-a096a97a-ba6d-462d-bca5-5aca26504235 req-695fb34c-d984-490b-922e-746efd3903fc tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Deleting attachment 7b147bc7-a58b-437e-b3e1-caf934e4f666. {{(pid=86706) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:27 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:27 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:27 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.709s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:29:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:29:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Acquiring lock "cinder-40c85237-ef6a-4f7c-926e-7a3328689099-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "cinder-40c85237-ef6a-4f7c-926e-7a3328689099-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Acquiring lock "cinder-quobyte-40c85237-ef6a-4f7c-926e-7a3328689099" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "cinder-quobyte-40c85237-ef6a-4f7c-926e-7a3328689099" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:29 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b2ffd-2250-48a8-a975-371868351902]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:29 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 Jul 06 12:29:29 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:29 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099" returned: 0 in 0.801s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:29 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099 Jul 06 12:29:29 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:30 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-40c85237-ef6a-4f7c-926e-7a3328689099" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "cinder-quobyte-40c85237-ef6a-4f7c-926e-7a3328689099" released by "delete_volume" :: held 1.590s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Created reservations ['e573eaf5-0819-4374-9f1f-bbbc7b4e3344', 'dcd98c2e-44c2-428c-9635-4fb4923c153e', '61966ebc-c4a9-4554-a7ec-af4a7b6116a6', '3c39d0d1-3fe8-453b-8710-c15918b9c4f1'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:30 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:30 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:31 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.780s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:31 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:31 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Deleted volume successfully. Jul 06 12:29:31 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96b867f3-7a91-493a-bbd2-ae8692b4e609 tempest-TestServerVolumeAttachScenarioOldVersion-2119921612 None] Lock "cinder-40c85237-ef6a-4f7c-926e-7a3328689099-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (a2662e24-65f5-444e-8ef2-2903135e7de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810421c5-33b2-4ac5-9a51-a89071aa7831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810421c5-33b2-4ac5-9a51-a89071aa7831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933180913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634a5481-c0f9-4526-8692-972fac3b63e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:37Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf34aef-ee35-43cb-93af-0b35c3877e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf34aef-ee35-43cb-93af-0b35c3877e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245447f6-e7e1-4c96-b0e5-469b6f0d9831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245447f6-e7e1-4c96-b0e5-469b6f0d9831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '634a5481-c0f9-4526-8692-972fac3b63e7', 'volume_name': 'volume-634a5481-c0f9-4526-8692-972fac3b63e7', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687a96db-9552-4fa9-b497-99018cab2ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687a96db-9552-4fa9-b497-99018cab2ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5280587-712c-4300-b508-7607e28b44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Volume 634a5481-c0f9-4526-8692-972fac3b63e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-634a5481-c0f9-4526-8692-972fac3b63e7', 'volume_size': 1} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933180913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634a5481-c0f9-4526-8692-972fac3b63e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:37Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Creating volume 634a5481-c0f9-4526-8692-972fac3b63e7 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:36 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:36 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 1073741824 Jul 06 12:29:36 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:37 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 1073741824" returned: 0 in 0.887s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:37 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 Jul 06 12:29:37 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:38 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7" returned: 0 in 0.678s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5280587-712c-4300-b508-7607e28b44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634a5481-c0f9-4526-8692-972fac3b63e7', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd404ac8-f2f4-4bd6-852b-e6b107c39b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:38 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Volume volume-634a5481-c0f9-4526-8692-972fac3b63e7 (634a5481-c0f9-4526-8692-972fac3b63e7): created successfully Jul 06 12:29:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd404ac8-f2f4-4bd6-852b-e6b107c39b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (a2662e24-65f5-444e-8ef2-2903135e7de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:38 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ff8cc59d-1eb8-48cc-9b1a-3f40496086cb tempest-ProjectReaderTests-1900963883 None] Created volume successfully. Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-634a5481-c0f9-4526-8692-972fac3b63e7-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Lock "cinder-634a5481-c0f9-4526-8692-972fac3b63e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-quobyte-634a5481-c0f9-4526-8692-972fac3b63e7" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-634a5481-c0f9-4526-8692-972fac3b63e7" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a319ca74-4bce-40fd-96ef-7d75ca18ad75]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:39 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 Jul 06 12:29:39 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:39 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7" returned: 0 in 0.872s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:40 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7 Jul 06 12:29:40 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:40 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-634a5481-c0f9-4526-8692-972fac3b63e7" returned: 0 in 0.760s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-634a5481-c0f9-4526-8692-972fac3b63e7" released by "delete_volume" :: held 1.674s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Created reservations ['717cc16b-c3e2-4a63-a2be-b140053973bf', 'ccb0b685-8bb8-4fe8-aa9e-44fb35426d62', '05769700-9ed0-46ab-8e46-530fa6a10eb7', '97308a78-818d-451f-99bc-41f93204426b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:40 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:40 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:41 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Deleted volume successfully. Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-706dbbfd-ba05-4561-ae0c-0f884a4e6b8a tempest-ProjectReaderTests-1900963883 None] Lock "cinder-634a5481-c0f9-4526-8692-972fac3b63e7-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (1a0e302b-b82d-4417-9885-a98195a5da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e836f9-794e-45e6-bc9c-b33101eeb02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e836f9-794e-45e6-bc9c-b33101eeb02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124175755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6c182b-88fd-45dd-b337-b93cb278e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:42Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a593e2-711d-41d1-86a2-f0e5ec86aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a593e2-711d-41d1-86a2-f0e5ec86aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f9b29d-bd49-441b-9642-d8ffc8db194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f9b29d-bd49-441b-9642-d8ffc8db194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6c182b-88fd-45dd-b337-b93cb278e3fa', 'volume_name': 'volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee37410-ac56-442e-9cd7-4c1fb2077621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee37410-ac56-442e-9cd7-4c1fb2077621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac04f74-800b-4c2c-81d6-6c926e3a75de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:41 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Volume 6c6c182b-88fd-45dd-b337-b93cb278e3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa', 'volume_size': 1} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124175755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6c182b-88fd-45dd-b337-b93cb278e3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:42Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Creating volume 6c6c182b-88fd-45dd-b337-b93cb278e3fa {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:42 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:42 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa 1073741824 Jul 06 12:29:42 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:42 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa 1073741824" returned: 0 in 0.987s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:43 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa Jul 06 12:29:43 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:43 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa" returned: 0 in 0.749s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac04f74-800b-4c2c-81d6-6c926e3a75de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa34213-5990-4475-a707-71fdfa0a5aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:43 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Volume volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa (6c6c182b-88fd-45dd-b337-b93cb278e3fa): created successfully Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa34213-5990-4475-a707-71fdfa0a5aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (1a0e302b-b82d-4417-9885-a98195a5da46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:43 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ce8c9679-3495-4f05-bb7c-456e55275d5e tempest-ProjectReaderTests-1900963883 None] Created volume successfully. Jul 06 12:29:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-6c6c182b-88fd-45dd-b337-b93cb278e3fa-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-6c6c182b-88fd-45dd-b337-b93cb278e3fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-quobyte-6c6c182b-88fd-45dd-b337-b93cb278e3fa" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-6c6c182b-88fd-45dd-b337-b93cb278e3fa" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2894a-84c3-4137-bff3-230099cd8a0c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:45 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa Jul 06 12:29:45 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:46 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa" returned: 0 in 0.901s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:46 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa Jul 06 12:29:46 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:46 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6c6c182b-88fd-45dd-b337-b93cb278e3fa" returned: 0 in 0.755s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-6c6c182b-88fd-45dd-b337-b93cb278e3fa" released by "delete_volume" :: held 1.697s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:46 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Created reservations ['1dbe9ab2-38a6-4db6-9424-4e6ecd865374', '6e12ada3-1532-40b6-b4e8-6db92f53c14d', '4d0b43e7-a16a-46bc-8721-330791abdab4', 'a6d5097e-7ab8-4a8b-8254-a501806c1270'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:47 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:47 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:47 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (87c7ea18-841e-4ec6-8017-7ce826ab6695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26578e64-8024-45ad-bedd-811eb0cf6fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.945s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Deleted volume successfully. Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26578e64-8024-45ad-bedd-811eb0cf6fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914619560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4819a599-4713-477b-a62c-238f03bd2a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:48Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14997e26-9bbf-4575-8cc9-d997a2704c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14997e26-9bbf-4575-8cc9-d997a2704c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f169d7b3-90ce-4e7f-9ba6-607c8109535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f169d7b3-90ce-4e7f-9ba6-607c8109535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4819a599-4713-477b-a62c-238f03bd2a6a', 'volume_name': 'volume-4819a599-4713-477b-a62c-238f03bd2a6a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478c3abb-b73d-4417-ab6a-4416c8f30998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478c3abb-b73d-4417-ab6a-4416c8f30998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f06449-ccf9-4286-b181-71fd905afce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:48 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Volume 4819a599-4713-477b-a62c-238f03bd2a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4819a599-4713-477b-a62c-238f03bd2a6a', 'volume_size': 1} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914619560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4819a599-4713-477b-a62c-238f03bd2a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:48Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Creating volume 4819a599-4713-477b-a62c-238f03bd2a6a {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:48 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3e0a2fc3-7483-4175-96b5-d6e250f1b381 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-6c6c182b-88fd-45dd-b337-b93cb278e3fa-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:48 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a 1073741824 Jul 06 12:29:48 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:49 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a 1073741824" returned: 0 in 1.115s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:49 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a Jul 06 12:29:49 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:49 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a" returned: 0 in 0.763s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f06449-ccf9-4286-b181-71fd905afce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4819a599-4713-477b-a62c-238f03bd2a6a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964a17e1-319c-4bea-b9db-20726abd0e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:50 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Volume volume-4819a599-4713-477b-a62c-238f03bd2a6a (4819a599-4713-477b-a62c-238f03bd2a6a): created successfully Jul 06 12:29:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964a17e1-319c-4bea-b9db-20726abd0e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (87c7ea18-841e-4ec6-8017-7ce826ab6695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-829923f2-bd38-4802-bd78-e05623a65771 tempest-ProjectReaderTests-1900963883 None] Created volume successfully. Jul 06 12:29:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-4819a599-4713-477b-a62c-238f03bd2a6a-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-4819a599-4713-477b-a62c-238f03bd2a6a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-quobyte-4819a599-4713-477b-a62c-238f03bd2a6a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-4819a599-4713-477b-a62c-238f03bd2a6a" acquired by "delete_volume" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a7170-7114-4679-b56d-f6d18adae920]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:51 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a Jul 06 12:29:51 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (df10ecbf-9def-4d8e-8e9b-def5c26b3dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6570b7b-e461-404f-ae78-76927dd571f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6570b7b-e461-404f-ae78-76927dd571f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990410532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49452759-b14e-4e31-a38a-523ac67d824e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:52Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78e4574-fd44-4e9c-982a-bb1898be69ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78e4574-fd44-4e9c-982a-bb1898be69ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd05b403-95d5-41a0-b80e-3159203013f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd05b403-95d5-41a0-b80e-3159203013f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49452759-b14e-4e31-a38a-523ac67d824e', 'volume_name': 'volume-49452759-b14e-4e31-a38a-523ac67d824e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee7236-76c1-46d4-84c2-548ed849d7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee7236-76c1-46d4-84c2-548ed849d7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5381373d-adf9-435b-8534-71f15e034f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:52 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume 49452759-b14e-4e31-a38a-523ac67d824e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49452759-b14e-4e31-a38a-523ac67d824e', 'volume_size': 1} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990410532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49452759-b14e-4e31-a38a-523ac67d824e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:52Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Creating volume 49452759-b14e-4e31-a38a-523ac67d824e {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:52 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:52 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e 1073741824 Jul 06 12:29:52 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:52 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a" returned: 0 in 0.889s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:52 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a Jul 06 12:29:52 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:52 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-4819a599-4713-477b-a62c-238f03bd2a6a" returned: 0 in 0.695s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-4819a599-4713-477b-a62c-238f03bd2a6a" released by "delete_volume" :: held 1.649s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:52 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Created reservations ['06f03a56-28e5-4c25-9e2d-aab5cc9ba1b7', 'ecee9264-4285-4ef8-a202-dbeceaded4b6', 'b19b3f7e-909a-4143-867c-7214c00bf381', '238a7aaa-f338-4ee1-9ce2-45ec74590ce3'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:53 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e 1073741824" returned: 0 in 0.896s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:53 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e Jul 06 12:29:53 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:53 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:53 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:53 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e" returned: 0 in 0.699s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5381373d-adf9-435b-8534-71f15e034f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49452759-b14e-4e31-a38a-523ac67d824e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704488ac-489c-42e4-9a87-d5c82889d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.707s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Deleted volume successfully. Jul 06 12:29:53 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume volume-49452759-b14e-4e31-a38a-523ac67d824e (49452759-b14e-4e31-a38a-523ac67d824e): created successfully Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704488ac-489c-42e4-9a87-d5c82889d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (df10ecbf-9def-4d8e-8e9b-def5c26b3dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8ee0c7a3-2703-4f04-b714-f3ebd6fe5a56 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-4819a599-4713-477b-a62c-238f03bd2a6a-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6515da51-8b27-494f-a20e-f1f927fe531e tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created volume successfully. Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:53 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (295777b8-33ac-421c-822d-056ea7367295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570e693a-d745-499b-946c-a8ea7a7ad89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570e693a-d745-499b-946c-a8ea7a7ad89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697535053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e5ad3a-bf73-4303-8807-8e44339e9f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:54Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758ff3eb-290c-4086-80c5-fef34e14f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758ff3eb-290c-4086-80c5-fef34e14f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb38c3f-2fd4-4466-9440-dab7098d619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb38c3f-2fd4-4466-9440-dab7098d619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e5ad3a-bf73-4303-8807-8e44339e9f05', 'volume_name': 'volume-42e5ad3a-bf73-4303-8807-8e44339e9f05', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2f9f1e-3b14-49c3-88dc-903ef9ce2942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2f9f1e-3b14-49c3-88dc-903ef9ce2942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd10600-4f9a-44d3-b47b-33a4697526e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Volume 42e5ad3a-bf73-4303-8807-8e44339e9f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e5ad3a-bf73-4303-8807-8e44339e9f05', 'volume_size': 1} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697535053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e5ad3a-bf73-4303-8807-8e44339e9f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2f76ea1fc04fe2ba18c85c3487ad08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:54Z,use_quota=True,user_id='efc24d364c864ed492e3ab1151083761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Creating volume 42e5ad3a-bf73-4303-8807-8e44339e9f05 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:54 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:54 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 1073741824 Jul 06 12:29:54 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (276ffff8-e004-4cbe-943e-b4b33dbf1227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8c6e5f-d827-487f-9934-11e5eb06048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8c6e5f-d827-487f-9934-11e5eb06048c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519375636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65686f6-ad86-4c41-b3f0-a5feeff33070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65686f6-ad86-4c41-b3f0-a5feeff33070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf9339d-a56c-4225-aed0-7f9f8d962472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf9339d-a56c-4225-aed0-7f9f8d962472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1', 'volume_name': 'volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420d1f6d-589b-412d-bd00-205a1313fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420d1f6d-589b-412d-bd00-205a1313fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18f9629-b7e1-4fbf-b3e3-297bdfee4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:54 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume 72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1', 'volume_size': 1} Jul 06 12:29:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (23a662c7-a27a-4ad1-a0f2-70a51ac2cbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9bd0e6-3497-4d83-928f-c8440e42d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 1073741824" returned: 0 in 0.993s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9bd0e6-3497-4d83-928f-c8440e42d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522914082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0670cdbd-2d14-4dfc-b86a-219c0b9392a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0282bb-4b89-4bf5-9f53-e53031e93816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0282bb-4b89-4bf5-9f53-e53031e93816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bacfc70-995f-4699-a350-e057eef08952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bacfc70-995f-4699-a350-e057eef08952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0670cdbd-2d14-4dfc-b86a-219c0b9392a3', 'volume_name': 'volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae14b8da-c320-4e00-a988-ee224255e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae14b8da-c320-4e00-a988-ee224255e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f54799-5ba0-489c-a22d-54224576350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume 0670cdbd-2d14-4dfc-b86a-219c0b9392a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3', 'volume_size': 1} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:55 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 Jul 06 12:29:55 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (63bedac8-57e1-4281-8c9c-42dc15d2a271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d1a6f8-e28d-4a76-9db3-53cfd9302bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d1a6f8-e28d-4a76-9db3-53cfd9302bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728659534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a922b63b-0fec-4af6-9ec2-4d875d0cca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a922b63b-0fec-4af6-9ec2-4d875d0cca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be0bdf4-367e-4d00-a940-9d1c19e6437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be0bdf4-367e-4d00-a940-9d1c19e6437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8', 'volume_name': 'volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd666cd-1b31-4ccb-9efb-82fab43fdff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd666cd-1b31-4ccb-9efb-82fab43fdff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cff6926-850e-4d43-842f-a5efd6f0a3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume 7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8', 'volume_size': 1} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (ff901bad-4f92-4c5d-8f73-ec651a884cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8ad8bd-d3f3-4cde-b954-7716411ba2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8ad8bd-d3f3-4cde-b954-7716411ba2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018797819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463da73b-cc29-42aa-9e0c-5f1e47be416f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:56Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc44e39f-878d-4c1a-aace-9ade934f83a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc44e39f-878d-4c1a-aace-9ade934f83a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d4a97e-6054-412c-958f-934e5788e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d4a97e-6054-412c-958f-934e5788e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463da73b-cc29-42aa-9e0c-5f1e47be416f', 'volume_name': 'volume-463da73b-cc29-42aa-9e0c-5f1e47be416f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976764eb-f395-459e-9978-0a325cb6d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976764eb-f395-459e-9978-0a325cb6d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc852807-7644-4855-9f5b-09de372c1fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume 463da73b-cc29-42aa-9e0c-5f1e47be416f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463da73b-cc29-42aa-9e0c-5f1e47be416f', 'volume_size': 1} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05" returned: 0 in 0.792s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519375636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Creating volume 72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:55 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:55 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 1073741824 Jul 06 12:29:55 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd10600-4f9a-44d3-b47b-33a4697526e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e5ad3a-bf73-4303-8807-8e44339e9f05', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce863044-7432-4471-b581-9326f9f7b857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Volume volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 (42e5ad3a-bf73-4303-8807-8e44339e9f05): created successfully Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce863044-7432-4471-b581-9326f9f7b857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Flow 'volume_create_manager' (295777b8-33ac-421c-822d-056ea7367295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5c3f15e9-0553-47c8-bdc3-f2e15a1d3b80 tempest-ProjectReaderTests-1900963883 None] Created volume successfully. Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (631d9a11-7ec6-4e38-92ef-abbe73fda3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdca2af-9575-4c63-a36f-b63dd2b912bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdca2af-9575-4c63-a36f-b63dd2b912bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1815379978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6d36f5-a8ce-4dd8-8d91-7ebc77eee918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:56Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a02262e-4ac9-451d-82eb-453c27bd6bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a02262e-4ac9-451d-82eb-453c27bd6bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340834b8-c25c-4bc1-a4a7-ade56c83e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340834b8-c25c-4bc1-a4a7-ade56c83e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6d36f5-a8ce-4dd8-8d91-7ebc77eee918', 'volume_name': 'volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7075b5bc-9aff-46d5-807e-2cf572ead432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7075b5bc-9aff-46d5-807e-2cf572ead432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188a652c-a97c-4082-bfcb-672a57b4fc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume af6d36f5-a8ce-4dd8-8d91-7ebc77eee918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918', 'volume_size': 1} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:56 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 1073741824" returned: 0 in 0.815s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:56 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 Jul 06 12:29:56 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-42e5ad3a-bf73-4303-8807-8e44339e9f05-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-42e5ad3a-bf73-4303-8807-8e44339e9f05-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "cinder-quobyte-42e5ad3a-bf73-4303-8807-8e44339e9f05" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-42e5ad3a-bf73-4303-8807-8e44339e9f05" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08af46e-f1b6-4009-8d43-72b3a97d76f4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:57 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 Jul 06 12:29:57 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:57 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1" returned: 0 in 0.726s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522914082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0670cdbd-2d14-4dfc-b86a-219c0b9392a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Creating volume 0670cdbd-2d14-4dfc-b86a-219c0b9392a3 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:57 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:57 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 1073741824 Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18f9629-b7e1-4fbf-b3e3-297bdfee4db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:57 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0cb4d9-f99d-463b-9266-87eded0e942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 (72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1): created successfully Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0cb4d9-f99d-463b-9266-87eded0e942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (276ffff8-e004-4cbe-943e-b4b33dbf1227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-67ac39b4-09df-43ed-b961-c0f376e23dcf tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created volume successfully. Jul 06 12:29:58 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05" returned: 0 in 0.814s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:58 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05 Jul 06 12:29:58 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:58 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 1073741824" returned: 0 in 0.917s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:58 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 Jul 06 12:29:58 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:58 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-42e5ad3a-bf73-4303-8807-8e44339e9f05" returned: 0 in 0.693s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-quobyte-42e5ad3a-bf73-4303-8807-8e44339e9f05" released by "delete_volume" :: held 1.548s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Created reservations ['3eaf940b-4218-4211-b2f2-2b904d0738be', '34188840-2d53-49ea-8d9d-4540c262fb62', 'fe0594af-1e0f-422d-881f-e4a78ad1815e', '0238eae9-34f5-475b-a709-12d489c35e04'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:59 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:29:59 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:59 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3" returned: 0 in 0.728s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.709s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728659534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Creating volume 7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:59 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:59 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 1073741824 Jul 06 12:29:59 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f54799-5ba0-489c-a22d-54224576350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a76a19-5b81-4e37-ae96-746c29522928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:59 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 (0670cdbd-2d14-4dfc-b86a-219c0b9392a3): created successfully Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a76a19-5b81-4e37-ae96-746c29522928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (23a662c7-a27a-4ad1-a0f2-70a51ac2cbbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9286bd93-79fd-43eb-a4a0-cefcf6d3973c tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created volume successfully. Jul 06 12:29:59 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Deleted volume successfully. Jul 06 12:29:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-739c078c-3782-48af-9066-fffdef2dde79 tempest-ProjectReaderTests-1900963883 None] Lock "cinder-42e5ad3a-bf73-4303-8807-8e44339e9f05-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:00 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 1073741824" returned: 0 in 0.997s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:00 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 Jul 06 12:30:00 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:01 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8" returned: 0 in 0.771s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.126s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018797819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463da73b-cc29-42aa-9e0c-5f1e47be416f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:56Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Creating volume 463da73b-cc29-42aa-9e0c-5f1e47be416f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:01 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cff6926-850e-4d43-842f-a5efd6f0a3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:01 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f 1073741824 Jul 06 12:30:01 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724d07c9-6232-4f7f-9592-004a55d2d6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:01 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 (7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8): created successfully Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724d07c9-6232-4f7f-9592-004a55d2d6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (63bedac8-57e1-4281-8c9c-42dc15d2a271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f7943fb5-7f28-4bbc-89d9-cdba009fbbe4 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created volume successfully. Jul 06 12:30:01 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f 1073741824" returned: 0 in 0.917s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:02 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f Jul 06 12:30:02 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:02 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f" returned: 0 in 0.672s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.384s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1815379978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6d36f5-a8ce-4dd8-8d91-7ebc77eee918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57900b52cd4824890eb5716ca063ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:56Z,use_quota=True,user_id='2020d4cb34344b42baa24732d4553a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Creating volume af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:02 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc852807-7644-4855-9f5b-09de372c1fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463da73b-cc29-42aa-9e0c-5f1e47be416f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:02 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 1073741824 Jul 06 12:30:02 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84639f03-b8ff-4ba5-a605-cf5d70a9fa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:02 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume volume-463da73b-cc29-42aa-9e0c-5f1e47be416f (463da73b-cc29-42aa-9e0c-5f1e47be416f): created successfully Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84639f03-b8ff-4ba5-a605-cf5d70a9fa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:02 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (ff901bad-4f92-4c5d-8f73-ec651a884cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e384b458-54fe-42be-a23a-9e9e3cbfaaa7 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created volume successfully. Jul 06 12:30:03 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 1073741824" returned: 0 in 0.828s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:03 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 Jul 06 12:30:03 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:04 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918" returned: 0 in 0.615s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188a652c-a97c-4082-bfcb-672a57b4fc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b1a38f-38d1-4b02-bf38-1a501ff0e79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:04 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Volume volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 (af6d36f5-a8ce-4dd8-8d91-7ebc77eee918): created successfully Jul 06 12:30:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b1a38f-38d1-4b02-bf38-1a501ff0e79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:04 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Flow 'volume_create_manager' (631d9a11-7ec6-4e38-92ef-abbe73fda3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:04 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5f827202-20ae-4f2c-953a-57211a644bf5 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created volume successfully. Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-quobyte-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6cd349-2a49-44b9-ad8b-fbb231288d09]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:05 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 Jul 06 12:30:05 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:05 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918" returned: 0 in 0.733s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:05 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918 Jul 06 12:30:05 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:06 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918" returned: 0 in 0.636s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918" released by "delete_volume" :: held 1.411s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created reservations ['879aeb2e-dba5-4e4f-ab3d-fc5e80f49a4d', 'f0b19f4a-1f0c-412d-a119-b9fb9dc48387', '2b4efb72-45d4-4862-b5a5-809e5c0a4d90', '9099dc77-a8eb-4855-a8f1-edc0a54db29f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:06 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:30:06 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:07 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.621s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Deleted volume successfully. Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-463da73b-cc29-42aa-9e0c-5f1e47be416f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d3d053ab-2afc-42e2-9dee-b18c71069578 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-af6d36f5-a8ce-4dd8-8d91-7ebc77eee918-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-463da73b-cc29-42aa-9e0c-5f1e47be416f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-quobyte-463da73b-cc29-42aa-9e0c-5f1e47be416f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-463da73b-cc29-42aa-9e0c-5f1e47be416f" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1f118-f10f-459e-a432-5c22e1c6aaee]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:07 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f Jul 06 12:30:07 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:08 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f" returned: 0 in 0.720s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:08 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f Jul 06 12:30:08 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:08 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-463da73b-cc29-42aa-9e0c-5f1e47be416f" returned: 0 in 0.638s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-463da73b-cc29-42aa-9e0c-5f1e47be416f" released by "delete_volume" :: held 1.394s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created reservations ['51f8169a-b6c9-4a4d-9b38-fc9d4f41f045', '66404356-4aa9-42de-843b-ac8200d5d928', 'e20b2412-6c5e-402d-ae84-1bc651c28394', 'bb4e92e4-b04d-4157-ad0e-af960cf2afd7'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:09 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:30:09 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:09 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.667s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Deleted volume successfully. Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-723cd3eb-3a82-4e0f-a12c-0f555578afa0 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-463da73b-cc29-42aa-9e0c-5f1e47be416f-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-quobyte-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb66f29-e2f1-4010-9853-3e34fe5e2f4b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:09 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 Jul 06 12:30:09 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:10 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:10 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8 Jul 06 12:30:10 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:11 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8" returned: 0 in 0.678s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8" released by "delete_volume" :: held 1.501s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created reservations ['a4eece23-0d02-47b2-99a6-d487ee8b710f', '61f3af45-7ed9-4261-a82e-d6624e8b29de', 'fa640187-bdeb-4ee2-85c0-c3888d3a8580', 'd0b7df92-3aaf-47b9-ae7b-0a4a2697e2a8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:11 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:30:11 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-0670cdbd-2d14-4dfc-b86a-219c0b9392a3-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-0670cdbd-2d14-4dfc-b86a-219c0b9392a3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-quobyte-0670cdbd-2d14-4dfc-b86a-219c0b9392a3" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-0670cdbd-2d14-4dfc-b86a-219c0b9392a3" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:12 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49df827-580d-4d2b-865b-93c513f1dcb5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:12 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.669s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:12 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Deleted volume successfully. Jul 06 12:30:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-18e49993-98e1-4d75-8c28-f450b69c2055 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-7f6faf68-bbbc-4e0f-9693-3a2e7c08b0c8-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:12 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 Jul 06 12:30:12 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:12 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3" returned: 0 in 0.765s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:12 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3 Jul 06 12:30:12 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:13 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-0670cdbd-2d14-4dfc-b86a-219c0b9392a3" returned: 0 in 0.661s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-0670cdbd-2d14-4dfc-b86a-219c0b9392a3" released by "delete_volume" :: held 1.465s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created reservations ['6375faff-bed0-4f5d-a7ef-604baeb9edcc', '6953af25-e239-4cfa-92b6-cb26ea94d481', '2a8b2132-768d-4afc-adea-5346d9b9b705', 'ec97b39f-cc2b-4a54-80e8-ac87d4eb8a19'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:13 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:30:13 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-quobyte-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb1731-56ad-49a3-8524-5de5b43334a8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:14 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.742s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Deleted volume successfully. Jul 06 12:30:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-09a880c0-bd84-477c-b202-e23d2d5cefb9 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-0670cdbd-2d14-4dfc-b86a-219c0b9392a3-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:14 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 Jul 06 12:30:14 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:15 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1" returned: 0 in 0.764s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:15 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1 Jul 06 12:30:15 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:15 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1" returned: 0 in 0.716s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1" released by "delete_volume" :: held 1.523s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created reservations ['d008c131-f0ae-42a1-bd34-ffaf5c39cb85', '8443f36f-f64b-416d-898e-f785c6111897', '6a29fc00-c042-427e-9364-5b8ada10d9a9', 'f99e6ba3-45d9-4678-8244-3e590859b9a3'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:15 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:30:15 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-49452759-b14e-4e31-a38a-523ac67d824e-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-49452759-b14e-4e31-a38a-523ac67d824e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "cinder-quobyte-49452759-b14e-4e31-a38a-523ac67d824e" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-49452759-b14e-4e31-a38a-523ac67d824e" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d8c46-98ca-47a2-8bcd-85ab5312dc69]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:16 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.720s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:16 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Deleted volume successfully. Jul 06 12:30:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3f3cfbf3-acf8-466e-b889-a616e1851913 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-72d9a9af-b1d2-466e-b9cb-88ad4f5e90c1-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:16 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e Jul 06 12:30:16 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:17 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:17 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e Jul 06 12:30:17 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:18 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-49452759-b14e-4e31-a38a-523ac67d824e" returned: 0 in 0.631s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-quobyte-49452759-b14e-4e31-a38a-523ac67d824e" released by "delete_volume" :: held 1.484s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Created reservations ['3df8a6db-1898-419d-a177-5d4bdfea3ee3', '188f053d-741f-45a1-a8c8-604340d52958', '3f15b0d7-feab-4537-a676-546f7074d395', '059f4e40-bf6d-4d5f-b36f-b4c31baba306'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:18 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:30:18 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:18 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.662s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Deleted volume successfully. Jul 06 12:30:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-937c2369-672e-4e6f-b819-952b62ee9978 tempest-CreateVolumesFromSourceVolumeTest-1673316180 None] Lock "cinder-49452759-b14e-4e31-a38a-523ac67d824e-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:27 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:30:27 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:27 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.696s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:30:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:30:28 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=65,cinder:UPDATE=116,cinder:INSERT=32,cinder:DELETE=7 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:30:28 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=86,cinder:INSERT=22,cinder:UPDATE=121,cinder:DELETE=14 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Flow 'volume_create_manager' (c886efbf-de51-46c6-8880-508b0188a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15c17c3-dd44-4432-abd6-8653b864ca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15c17c3-dd44-4432-abd6-8653b864ca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1685668982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995cc8f8825d46f4878be93b3eb7f62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:42Z,use_quota=True,user_id='c9dc73e2d2c64aceafd032c34c8f2599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45f8c80-23da-47a1-afcb-b290142eed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45f8c80-23da-47a1-afcb-b290142eed5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cd33be-e4f9-45eb-a5e1-86a2fafdf70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cd33be-e4f9-45eb-a5e1-86a2fafdf70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a', 'volume_name': 'volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ae7ab5-db8f-4439-9ca2-c3a4a1b9a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ae7ab5-db8f-4439-9ca2-c3a4a1b9a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55e75f8-7551-4a64-af8d-b4d34136cdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:42 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Volume 86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a', 'volume_size': 1} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1685668982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995cc8f8825d46f4878be93b3eb7f62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:42Z,use_quota=True,user_id='c9dc73e2d2c64aceafd032c34c8f2599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Creating volume 86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:42 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:30:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:42 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a 1073741824 Jul 06 12:30:42 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:43 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a 1073741824" returned: 0 in 0.873s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:43 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a Jul 06 12:30:43 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:43 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" returned: 0 in 0.695s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55e75f8-7551-4a64-af8d-b4d34136cdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a246e95-e2fc-4443-98db-3a27e3f79ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:43 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Volume volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a (86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a): created successfully Jul 06 12:30:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a246e95-e2fc-4443-98db-3a27e3f79ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Flow 'volume_create_manager' (c886efbf-de51-46c6-8880-508b0188a904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9b132732-e960-438c-82fa-8c5f1ea5a1aa tempest-SnapshotDependencyTests-473459898 None] Created volume successfully. Jul 06 12:30:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Creating offline snapshot d1980398-24be-468a-8ef0-fa696d5cefa7 of volume 86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:30:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a188feb-83de-4160-815a-f29067d952cd]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:44 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a Jul 06 12:30:44 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:45 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" returned: 0 in 0.819s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:45 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 1G Jul 06 12:30:45 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:46 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 1G" returned: 0 in 0.863s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:46 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 Jul 06 12:30:46 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:47 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7" returned: 0 in 0.767s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:47 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 is being set with open permissions: ugo+rw Jul 06 12:30:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:47 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 Jul 06 12:30:47 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:47 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7" returned: 0 in 0.736s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:47 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.info Jul 06 12:30:47 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:48 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.info" returned: 0 in 0.636s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:48 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.info is being set with open permissions: ugo+rw Jul 06 12:30:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:48 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.info Jul 06 12:30:48 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:49 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.info" returned: 0 in 0.619s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.524s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5e378b28-2214-43b8-8167-d5f00f35214a tempest-SnapshotDependencyTests-473459898 None] Create snapshot completed successfully Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Flow 'volume_create_manager' (1ca1f78b-9b80-4aad-ba85-7e6ee3c504d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe060323-cf97-4993-baed-2699f0ecf0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe060323-cf97-4993-baed-2699f0ecf0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a910bf-6124-47a1-9f7f-6f367919ff47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995cc8f8825d46f4878be93b3eb7f62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1980398-24be-468a-8ef0-fa696d5cefa7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:50Z,use_quota=True,user_id='c9dc73e2d2c64aceafd032c34c8f2599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b2e4c1-0102-4627-b2db-4274e989e110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b2e4c1-0102-4627-b2db-4274e989e110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0f161f-300d-4a92-9ba7-2506c8dd7f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0f161f-300d-4a92-9ba7-2506c8dd7f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '37a910bf-6124-47a1-9f7f-6f367919ff47', 'volume_name': 'volume-37a910bf-6124-47a1-9f7f-6f367919ff47', 'volume_size': 1, 'snapshot_id': 'd1980398-24be-468a-8ef0-fa696d5cefa7'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80d3c01-34ea-4b8a-86b7-493bb62dac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80d3c01-34ea-4b8a-86b7-493bb62dac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb10cd72-950d-4e8a-b982-459eaf1548cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:50 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Volume 37a910bf-6124-47a1-9f7f-6f367919ff47: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-37a910bf-6124-47a1-9f7f-6f367919ff47', 'volume_size': 1, 'snapshot_id': 'd1980398-24be-468a-8ef0-fa696d5cefa7'} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-quobyte-d1980398-24be-468a-8ef0-fa696d5cefa7-37a910bf-6124-47a1-9f7f-6f367919ff47" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-d1980398-24be-468a-8ef0-fa696d5cefa7-37a910bf-6124-47a1-9f7f-6f367919ff47" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Creating volume 37a910bf-6124-47a1-9f7f-6f367919ff47 from snapshot d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-quobyte-37a910bf-6124-47a1-9f7f-6f367919ff47" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-37a910bf-6124-47a1-9f7f-6f367919ff47" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] snapshot: d1980398-24be-468a-8ef0-fa696d5cefa7, volume: 37a910bf-6124-47a1-9f7f-6f367919ff47, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b774f3-cc6e-48b2-85e7-c9ddb3f94ab4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:50 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 Jul 06 12:30:50 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:51 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7" returned: 0 in 0.766s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:30:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:30:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:30:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0017e877-4ff4-49de-9d4c-f4fa6716c84b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:51 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a Jul 06 12:30:51 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:52 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" returned: 0 in 0.761s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:52 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:30:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:52 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 Jul 06 12:30:52 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:56 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47" returned: 0 in 4.432s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372767a-8cf4-44c2-adc2-6d90703a9e69]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:56 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a Jul 06 12:30:56 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:57 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" returned: 0 in 0.889s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:57 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:30:57 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Converted 1024.00 MB image at 230.98 MB/s Jul 06 12:30:57 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 is being set with open permissions: ugo+rw Jul 06 12:30:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:57 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 Jul 06 12:30:57 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:58 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47" returned: 0 in 0.659s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-37a910bf-6124-47a1-9f7f-6f367919ff47" released by "_copy_volume_from_snapshot" :: held 7.603s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-d1980398-24be-468a-8ef0-fa696d5cefa7-37a910bf-6124-47a1-9f7f-6f367919ff47" released by "_create_volume_from_snapshot" :: held 7.633s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.647s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb10cd72-950d-4e8a-b982-459eaf1548cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a910bf-6124-47a1-9f7f-6f367919ff47', 'volume_size': 1, 'snapshot_id': 'd1980398-24be-468a-8ef0-fa696d5cefa7'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9b0c0f-d8ec-42ca-b8b8-e28188f46e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:58 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Volume volume-37a910bf-6124-47a1-9f7f-6f367919ff47 (37a910bf-6124-47a1-9f7f-6f367919ff47): created successfully Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9b0c0f-d8ec-42ca-b8b8-e28188f46e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Flow 'volume_create_manager' (1ca1f78b-9b80-4aad-ba85-7e6ee3c504d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a5ccaace-0cc0-4612-b3bc-f71cdd2792e6 tempest-SnapshotDependencyTests-473459898 None] Created volume successfully. Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-d1980398-24be-468a-8ef0-fa696d5cefa7-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-d1980398-24be-468a-8ef0-fa696d5cefa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-quobyte-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-quobyte-d1980398-24be-468a-8ef0-fa696d5cefa7" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-d1980398-24be-468a-8ef0-fa696d5cefa7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Deleting offline snapshot d1980398-24be-468a-8ef0-fa696d5cefa7 of volume 86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] snapshot_file for this snap is: volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfec9f9-39d3-4ee0-965c-247a8ee2d045]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:59 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 Jul 06 12:30:59 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:59 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7" returned: 0 in 0.734s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30afdd0-960c-43a3-a75a-3b4d852b4cf8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:00 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a Jul 06 12:31:00 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:00 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" returned: 0 in 0.767s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:00 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 Jul 06 12:31:00 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:01 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7" returned: 0 in 0.816s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:01 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7 Jul 06 12:31:01 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:02 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a.d1980398-24be-468a-8ef0-fa696d5cefa7" returned: 0 in 0.674s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-d1980398-24be-468a-8ef0-fa696d5cefa7" released by "_delete_snapshot" :: held 3.096s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" released by "delete_snapshot" :: held 3.121s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:02 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Created reservations ['b3f255c0-849e-4434-b03b-eab2e4887353', '42bad08d-ab0e-4ab9-9072-9f4974a3eb57', '763c2051-4226-477e-a3e9-b8c8e7060619', '651152b6-83b4-4ac9-9b31-2204e7d6e2d2'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Delete snapshot completed successfully. Jul 06 12:31:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-8b6d48a3-8143-4e65-aa10-9c539a32761d tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-d1980398-24be-468a-8ef0-fa696d5cefa7-delete_snapshot" released by "delete_snapshot" :: held 3.264s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-quobyte-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a715af9-6912-4e5e-a7f5-2ed1ddae93c5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:03 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a Jul 06 12:31:03 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:04 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" returned: 0 in 0.800s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:04 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a Jul 06 12:31:04 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:04 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" returned: 0 in 0.654s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a" released by "delete_volume" :: held 1.520s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Created reservations ['b2309f68-ed44-427d-beb4-ff7656981037', '1aa73bbf-edf8-48e0-96c8-1c78a97870ec', '33c3878e-9016-4b58-91c3-6392b5397282', 'b111e4e2-aefa-4e44-861a-5a5f1d8b0e71'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:05 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:05 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-37a910bf-6124-47a1-9f7f-6f367919ff47-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-37a910bf-6124-47a1-9f7f-6f367919ff47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "cinder-quobyte-37a910bf-6124-47a1-9f7f-6f367919ff47" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-37a910bf-6124-47a1-9f7f-6f367919ff47" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed63945-da8f-49fa-ae63-21ca6697eead]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:05 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.739s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Deleted volume successfully. Jul 06 12:31:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-d46240e5-4e44-479c-a268-7d9ab5e97003 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-86eeff44-e7f3-4c4c-bcf3-4a77f2b4dc6a-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:05 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 Jul 06 12:31:05 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:06 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47" returned: 0 in 0.794s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:06 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47 Jul 06 12:31:06 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:07 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-37a910bf-6124-47a1-9f7f-6f367919ff47" returned: 0 in 0.832s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-quobyte-37a910bf-6124-47a1-9f7f-6f367919ff47" released by "delete_volume" :: held 1.674s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Created reservations ['eb5de5fe-c5d8-4e07-965c-b7dce9d5de28', '7c3ec690-6361-4678-aff9-8bda30d6d6b1', '75011b1f-6b29-4258-b540-9fb0dc10d3f2', '7ddc698f-ca5f-4509-94bd-cda3e6305ffe'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:07 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:07 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:08 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.696s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:08 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Deleted volume successfully. Jul 06 12:31:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-7b78c623-690b-48c6-9c4a-58d8e182abf1 tempest-SnapshotDependencyTests-473459898 None] Lock "cinder-37a910bf-6124-47a1-9f7f-6f367919ff47-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:17 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:31:18 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:27 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:27 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:27 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.805s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:31:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (8e758807-c552-4d9f-a71f-4848cca4dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8c3641-db95-48a0-9aff-c80a2037a8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8c3641-db95-48a0-9aff-c80a2037a8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444502769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a853c0-6552-40a7-9985-870a0b70b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:28Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcbe16c-c473-4167-927c-8336f4562271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcbe16c-c473-4167-927c-8336f4562271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8af64e-dc42-4ff9-954a-cc0b7bb2f587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8af64e-dc42-4ff9-954a-cc0b7bb2f587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a853c0-6552-40a7-9985-870a0b70b17c', 'volume_name': 'volume-43a853c0-6552-40a7-9985-870a0b70b17c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9030d4-d366-4c39-ab8f-2eddc6a1274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9030d4-d366-4c39-ab8f-2eddc6a1274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa82dedc-dfb3-48fe-bb63-fd0258fa6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:28 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume 43a853c0-6552-40a7-9985-870a0b70b17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a853c0-6552-40a7-9985-870a0b70b17c', 'volume_size': 1} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444502769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a853c0-6552-40a7-9985-870a0b70b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:28Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Creating volume 43a853c0-6552-40a7-9985-870a0b70b17c {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:28 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:28 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c 1073741824 Jul 06 12:31:28 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (27ad56aa-45a7-4ad3-ab77-fe61a697f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd094be-db28-4942-8aa3-38aba876e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd094be-db28-4942-8aa3-38aba876e714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967147573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1651220b-c249-4e6e-a448-2a3238f09e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:29Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcb191-c52e-4955-a0cd-6135a0523ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbcb191-c52e-4955-a0cd-6135a0523ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae52165-2a8e-4e66-a718-9ebaba5967e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae52165-2a8e-4e66-a718-9ebaba5967e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1651220b-c249-4e6e-a448-2a3238f09e35', 'volume_name': 'volume-1651220b-c249-4e6e-a448-2a3238f09e35', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699f6144-1b3d-4043-81dd-0918fa2693e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699f6144-1b3d-4043-81dd-0918fa2693e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2152686-04e1-44ad-8af4-6106539b9d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Volume 1651220b-c249-4e6e-a448-2a3238f09e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1651220b-c249-4e6e-a448-2a3238f09e35', 'volume_size': 1} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (320853a4-9030-4b94-a441-0277cbf2bbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21267343-baba-4ab2-a797-2f4dfcdabea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21267343-baba-4ab2-a797-2f4dfcdabea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1481626382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a3a88c-e320-4880-8f81-fc4e249951b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:29Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371d3c4b-8837-4c77-a8ff-146a11e5d902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371d3c4b-8837-4c77-a8ff-146a11e5d902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7be4b7-e785-4703-9805-8da91e50f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7be4b7-e785-4703-9805-8da91e50f027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a3a88c-e320-4880-8f81-fc4e249951b3', 'volume_name': 'volume-68a3a88c-e320-4880-8f81-fc4e249951b3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df46f21-b7f6-461f-b3ed-0383a11d1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df46f21-b7f6-461f-b3ed-0383a11d1e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15aab3e8-f97f-4421-96a8-5369d8f2db8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:29 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Volume 68a3a88c-e320-4880-8f81-fc4e249951b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a3a88c-e320-4880-8f81-fc4e249951b3', 'volume_size': 1} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:29 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Flow 'volume_create_manager' (3ef7633a-ac64-49f3-a234-41c334d8c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e1036-793d-4e9f-bb9b-35e57cddc293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898e1036-793d-4e9f-bb9b-35e57cddc293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-972111803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97635db-b1e1-4407-9ec3-35841e301573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c042f4a0ac304ebb8a8b92ffa15eaf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:30Z,use_quota=True,user_id='7c7edcd557b44851a7138a06ac107f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d210ed-de8f-4113-a286-ef1c95849e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d210ed-de8f-4113-a286-ef1c95849e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1572d8-7e94-4e08-b0a8-d5885de8b46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1572d8-7e94-4e08-b0a8-d5885de8b46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97635db-b1e1-4407-9ec3-35841e301573', 'volume_name': 'volume-a97635db-b1e1-4407-9ec3-35841e301573', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5859e522-7b34-485c-8c2b-c26656d25316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5859e522-7b34-485c-8c2b-c26656d25316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182bd307-e308-4063-bcbe-4b77b0f8beb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Volume a97635db-b1e1-4407-9ec3-35841e301573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97635db-b1e1-4407-9ec3-35841e301573', 'volume_size': 1} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:30 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c 1073741824" returned: 0 in 1.398s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (dbbf74f6-9a7d-4470-adb2-dbf5f6736a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510a0d0d-62fe-4631-9d0a-956f2bc146f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510a0d0d-62fe-4631-9d0a-956f2bc146f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204843921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6eb512-c8f9-4972-9ce9-dfea7346860d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:30Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ad0dc4-6651-4b06-9419-6c88f572f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ad0dc4-6651-4b06-9419-6c88f572f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2512a18-8d02-40b0-a2b2-3f86199bb117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2512a18-8d02-40b0-a2b2-3f86199bb117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6eb512-c8f9-4972-9ce9-dfea7346860d', 'volume_name': 'volume-da6eb512-c8f9-4972-9ce9-dfea7346860d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f94f6d5-a26b-4b2c-b05b-34705642e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f94f6d5-a26b-4b2c-b05b-34705642e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc19fe1-4345-4147-a8a5-e5930352d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Volume da6eb512-c8f9-4972-9ce9-dfea7346860d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6eb512-c8f9-4972-9ce9-dfea7346860d', 'volume_size': 1} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:30 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c Jul 06 12:31:30 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (8438d109-bbe1-4938-8cc5-9aa9f08a7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dfdfa7-219a-4b23-9396-313659178c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dfdfa7-219a-4b23-9396-313659178c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272885302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:30Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7711d42f-c46b-42d6-9cbe-b6b75f75cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7711d42f-c46b-42d6-9cbe-b6b75f75cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1503762-7e5a-4c99-9981-10ef72e1305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1503762-7e5a-4c99-9981-10ef72e1305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4', 'volume_name': 'volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1515c29-05b2-4ead-b27d-702477beffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1515c29-05b2-4ead-b27d-702477beffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23f149a-e0e3-4488-af63-952db6694775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Volume e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4', 'volume_size': 1} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (a90aefb9-1fde-4c21-b1d0-217c7521efd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e3ff17-adf9-4c4d-b5e5-4c09c9f45030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e3ff17-adf9-4c4d-b5e5-4c09c9f45030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139652143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926dda87-2602-49c9-9127-234bbda52df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:31Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b662f-32e3-4796-ad84-23fb1204e80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b662f-32e3-4796-ad84-23fb1204e80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b43b16-fd8d-4dc6-9659-2fab23ed111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b43b16-fd8d-4dc6-9659-2fab23ed111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926dda87-2602-49c9-9127-234bbda52df5', 'volume_name': 'volume-926dda87-2602-49c9-9127-234bbda52df5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f018dda-27bd-4996-a3b1-0e5a88b338ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f018dda-27bd-4996-a3b1-0e5a88b338ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eb9fde-8ed9-4e82-8142-9b15091d9725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Volume 926dda87-2602-49c9-9127-234bbda52df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926dda87-2602-49c9-9127-234bbda52df5', 'volume_size': 1} Jul 06 12:31:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:31 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c" returned: 0 in 0.869s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.437s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.101s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967147573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1651220b-c249-4e6e-a448-2a3238f09e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:29Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Creating volume 1651220b-c249-4e6e-a448-2a3238f09e35 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:31 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:31 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 1073741824 Jul 06 12:31:31 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa82dedc-dfb3-48fe-bb63-fd0258fa6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a853c0-6552-40a7-9985-870a0b70b17c', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eeea05-8d65-49cd-bae5-3bf3d91fa85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume volume-43a853c0-6552-40a7-9985-870a0b70b17c (43a853c0-6552-40a7-9985-870a0b70b17c): created successfully Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eeea05-8d65-49cd-bae5-3bf3d91fa85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (8e758807-c552-4d9f-a71f-4848cca4dd48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:31 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e746ebe9-44f2-448b-9900-f5063537ee47 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created volume successfully. Jul 06 12:31:32 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 1073741824" returned: 0 in 0.948s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:32 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 Jul 06 12:31:32 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (9b86633b-bb10-4859-bf34-00755d68617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5c552f-4b47-4d78-8da9-a176fe1642fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5c552f-4b47-4d78-8da9-a176fe1642fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-318404691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0aae9e-9a2a-41e4-9934-eacf116b0451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:32Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0da96a-30d5-4e8c-8d92-734e6c18430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0da96a-30d5-4e8c-8d92-734e6c18430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9599d8-17fd-4554-946a-2fffc926134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9599d8-17fd-4554-946a-2fffc926134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0aae9e-9a2a-41e4-9934-eacf116b0451', 'volume_name': 'volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21a5e32-f802-4e75-85a4-73dcb0d45600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21a5e32-f802-4e75-85a4-73dcb0d45600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11108528-89be-4942-bacd-8d68ea5fbe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume 3b0aae9e-9a2a-41e4-9934-eacf116b0451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451', 'volume_size': 1} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (9e33c00c-d645-4e63-a309-e5cd76298d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b37989-0702-4a79-8fe7-1079d78a9e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b37989-0702-4a79-8fe7-1079d78a9e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369014627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687658b4-ba28-42ec-9459-f3dc0ea80070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:33Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3161f7-f713-49c9-b66d-43e27b5377cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3161f7-f713-49c9-b66d-43e27b5377cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc4e8a6-4c58-48ec-8605-2d1813a4d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc4e8a6-4c58-48ec-8605-2d1813a4d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687658b4-ba28-42ec-9459-f3dc0ea80070', 'volume_name': 'volume-687658b4-ba28-42ec-9459-f3dc0ea80070', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b137b810-be09-41a7-ac66-f38884033378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b137b810-be09-41a7-ac66-f38884033378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b402190c-1898-4d1d-9a37-cdcced882387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume 687658b4-ba28-42ec-9459-f3dc0ea80070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687658b4-ba28-42ec-9459-f3dc0ea80070', 'volume_size': 1} Jul 06 12:31:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:33 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35" returned: 0 in 1.062s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.815s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1481626382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a3a88c-e320-4880-8f81-fc4e249951b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:29Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Creating volume 68a3a88c-e320-4880-8f81-fc4e249951b3 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:33 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:33 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 1073741824 Jul 06 12:31:33 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2152686-04e1-44ad-8af4-6106539b9d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1651220b-c249-4e6e-a448-2a3238f09e35', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1185131d-f393-4622-99f9-e1d28c3ea8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Volume volume-1651220b-c249-4e6e-a448-2a3238f09e35 (1651220b-c249-4e6e-a448-2a3238f09e35): created successfully Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1185131d-f393-4622-99f9-e1d28c3ea8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (27ad56aa-45a7-4ad3-ab77-fe61a697f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0310cd59-ba7e-4652-93ed-104191517618 tempest-CreateVolumesFromImageTest-359790364 None] Created volume successfully. Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (483f0c0d-8499-4bad-a4a4-dc3ccf9e5967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f7f1f0-d267-4f97-b508-f4adf128fb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f7f1f0-d267-4f97-b508-f4adf128fb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496485918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1490f1f-a712-4ac4-89f5-419668d688ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:33Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37927ef-f7f7-4109-b2a5-4364e7d37ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37927ef-f7f7-4109-b2a5-4364e7d37ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95079e19-7f58-4fbc-b276-9eddf9f12ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95079e19-7f58-4fbc-b276-9eddf9f12ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1490f1f-a712-4ac4-89f5-419668d688ec', 'volume_name': 'volume-a1490f1f-a712-4ac4-89f5-419668d688ec', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6d4289-ae85-4369-bb43-7f9057d4b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6d4289-ae85-4369-bb43-7f9057d4b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8644bd47-0956-46b0-8650-ef13908a95fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume a1490f1f-a712-4ac4-89f5-419668d688ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1490f1f-a712-4ac4-89f5-419668d688ec', 'volume_size': 1} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Flow 'volume_create_manager' (47fabf60-0d0e-415b-b5cf-6af628c33ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081b7efc-1971-4f88-922a-2d6461d154b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081b7efc-1971-4f88-922a-2d6461d154b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0a26b1-ea76-4ec8-a5da-36c739b1f440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c378e0d8811426ebc142c8b25ffee0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:34Z,use_quota=True,user_id='412ac39d0bee491aa1a6e5ddc60e2a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(910bb5d9-ca28-41a9-8981-286671e31d28),volume_type_id=910bb5d9-ca28-41a9-8981-286671e31d28)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b43cfe4-31a1-42e6-8be0-c7dfca5884f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b43cfe4-31a1-42e6-8be0-c7dfca5884f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e225d35c-ef50-4301-a61b-648215abe018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:31:33 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (f798ec64-f5e4-4cb5-9475-7f71f1ebe935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e538222d-21ce-4c30-99d8-16351b5f2d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e538222d-21ce-4c30-99d8-16351b5f2d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537396815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982d1387-a979-434b-9ae5-3978db881137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:34Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6b034e-2f97-484d-bebe-0b235a3149da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6b034e-2f97-484d-bebe-0b235a3149da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce418d1-9346-4949-bfdb-9c42ccc068a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce418d1-9346-4949-bfdb-9c42ccc068a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982d1387-a979-434b-9ae5-3978db881137', 'volume_name': 'volume-982d1387-a979-434b-9ae5-3978db881137', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f98d539-5de0-4d96-b28b-fee266e1c013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f98d539-5de0-4d96-b28b-fee266e1c013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8f03c4-fda8-4a90-93e8-88f442a1ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume 982d1387-a979-434b-9ae5-3978db881137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982d1387-a979-434b-9ae5-3978db881137', 'volume_size': 1} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e225d35c-ef50-4301-a61b-648215abe018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be0a26b1-ea76-4ec8-a5da-36c739b1f440', 'volume_name': 'volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440', 'volume_size': 1, 'image_id': 'eb23a098-901b-4582-8d16-94e59510c229', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb23a098-901b-4582-8d16-94e59510c229', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09eacd6b9bc1fce872685a50f2d6f525', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c378e0d8811426ebc142c8b25ffee0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97dba251a140799f9753bd839ec27050df0fba8f1e999f562b8ebba8987458f5514677767a832825d23b7610218345c018ba31d3d8b4117120da82fa93c4eaa1', 'id': 'eb23a098-901b-4582-8d16-94e59510c229', 'created_at': datetime.datetime(2026, 7, 6, 10, 31, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 31, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb23a098-901b-4582-8d16-94e59510c229/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd2da53-96b0-4f55-90fc-839e589219ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd2da53-96b0-4f55-90fc-839e589219ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54127f81-325e-45c7-9bd4-cfc510871b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Volume be0a26b1-ea76-4ec8-a5da-36c739b1f440: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440', 'volume_size': 1, 'image_id': 'eb23a098-901b-4582-8d16-94e59510c229', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb23a098-901b-4582-8d16-94e59510c229', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09eacd6b9bc1fce872685a50f2d6f525', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c378e0d8811426ebc142c8b25ffee0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97dba251a140799f9753bd839ec27050df0fba8f1e999f562b8ebba8987458f5514677767a832825d23b7610218345c018ba31d3d8b4117120da82fa93c4eaa1', 'id': 'eb23a098-901b-4582-8d16-94e59510c229', 'created_at': datetime.datetime(2026, 7, 6, 10, 31, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 31, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb23a098-901b-4582-8d16-94e59510c229/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Trying to clone be0a26b1-ea76-4ec8-a5da-36c739b1f440 from image eb23a098-901b-4582-8d16-94e59510c229 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb23a098-901b-4582-8d16-94e59510c229', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (3e2dc62f-bc0d-46b9-93d6-3296c669f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc4917d-106d-4937-8918-e730c32168f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 1073741824" returned: 0 in 1.238s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc4917d-106d-4937-8918-e730c32168f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305668163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36d7488-919a-4c00-bdc5-f29231bab766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:34Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaca3ce-dcc9-452f-999f-06eced36f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaca3ce-dcc9-452f-999f-06eced36f067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bf6e0d-cc37-45a6-a778-753298555010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bf6e0d-cc37-45a6-a778-753298555010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36d7488-919a-4c00-bdc5-f29231bab766', 'volume_name': 'volume-b36d7488-919a-4c00-bdc5-f29231bab766', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fef695-2d06-40ad-94e5-cffb44747d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fef695-2d06-40ad-94e5-cffb44747d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69688dbf-049d-4a24-a1e0-585d95c0b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume b36d7488-919a-4c00-bdc5-f29231bab766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36d7488-919a-4c00-bdc5-f29231bab766', 'volume_size': 1} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:31:34 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:34 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 Jul 06 12:31:34 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3a3047-37d7-4453-9510-a5e4620a06e2]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:34 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD Jul 06 12:31:34 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:35 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3" returned: 0 in 0.745s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.223s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-972111803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97635db-b1e1-4407-9ec3-35841e301573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c042f4a0ac304ebb8a8b92ffa15eaf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:30Z,use_quota=True,user_id='7c7edcd557b44851a7138a06ac107f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Creating volume a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:35 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15aab3e8-f97f-4421-96a8-5369d8f2db8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a3a88c-e320-4880-8f81-fc4e249951b3', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:35 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 1073741824 Jul 06 12:31:35 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e74fd4-a716-4672-a3e8-ac2b58b7a51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:35 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Volume volume-68a3a88c-e320-4880-8f81-fc4e249951b3 (68a3a88c-e320-4880-8f81-fc4e249951b3): created successfully Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e74fd4-a716-4672-a3e8-ac2b58b7a51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (320853a4-9030-4b94-a441-0277cbf2bbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:35 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7d37366f-cf4b-431d-9ded-6196a190712f tempest-CreateVolumesFromImageTest-359790364 None] Created volume successfully. Jul 06 12:31:35 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:35 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD Jul 06 12:31:35 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:36 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD" returned: 1 in 0.732s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:31:36 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Temporary image eb23a098-901b-4582-8d16-94e59510c229 is fetched for user 412ac39d0bee491aa1a6e5ddc60e2a6b. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:31:36 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 1073741824" returned: 0 in 0.891s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:36 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856a6d4-f0b5-4d3a-a6ca-3f76b0d93c0b]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:36 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 Jul 06 12:31:36 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:36 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD Jul 06 12:31:36 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:37 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573" returned: 0 in 0.724s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.775s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204843921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6eb512-c8f9-4972-9ce9-dfea7346860d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:30Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Creating volume da6eb512-c8f9-4972-9ce9-dfea7346860d {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:37 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:37 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d 1073741824 Jul 06 12:31:37 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182bd307-e308-4063-bcbe-4b77b0f8beb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97635db-b1e1-4407-9ec3-35841e301573', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7da9b50-1685-4782-9122-d11ac0e14307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:37 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:37 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Volume volume-a97635db-b1e1-4407-9ec3-35841e301573 (a97635db-b1e1-4407-9ec3-35841e301573): created successfully Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7da9b50-1685-4782-9122-d11ac0e14307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Flow 'volume_create_manager' (3ef7633a-ac64-49f3-a234-41c334d8c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-53ff2fee-c97e-4185-9fa4-77d1e21a2084 tempest-VolumeDependencyTests-2119557014 None] Created volume successfully. Jul 06 12:31:37 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD Jul 06 12:31:37 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:37 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:31:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:38 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d 1073741824" returned: 0 in 0.940s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:38 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d Jul 06 12:31:38 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:38 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d" returned: 0 in 0.643s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.115s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272885302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:30Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Creating volume e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:38 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:38 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 1073741824 Jul 06 12:31:38 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc19fe1-4345-4147-a8a5-e5930352d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6eb512-c8f9-4972-9ce9-dfea7346860d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402a45a1-05b3-4f32-9b3f-4aabaf5d3343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:38 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Volume volume-da6eb512-c8f9-4972-9ce9-dfea7346860d (da6eb512-c8f9-4972-9ce9-dfea7346860d): created successfully Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402a45a1-05b3-4f32-9b3f-4aabaf5d3343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:38 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (dbbf74f6-9a7d-4470-adb2-dbf5f6736a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:38 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ce7569aa-93ff-4dd2-9790-ca27454038fd tempest-CreateVolumesFromImageTest-359790364 None] Created volume successfully. Jul 06 12:31:39 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 1073741824" returned: 0 in 0.928s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:39 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 Jul 06 12:31:39 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:40 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4" returned: 0 in 0.638s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.360s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139652143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926dda87-2602-49c9-9127-234bbda52df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb23ad30bd1a41a2a06fcd7ca07735be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:31Z,use_quota=True,user_id='719c591261484c38a338959ba487e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Creating volume 926dda87-2602-49c9-9127-234bbda52df5 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:40 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23f149a-e0e3-4488-af63-952db6694775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:40 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 1073741824 Jul 06 12:31:40 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8ced5b-aee6-403e-b8bc-5770d288e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:40 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Volume volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 (e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4): created successfully Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8ced5b-aee6-403e-b8bc-5770d288e454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (8438d109-bbe1-4938-8cc5-9aa9f08a7884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:40 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-bd6277f1-34e8-42a6-abb9-ee4f93182aca tempest-CreateVolumesFromImageTest-359790364 None] Created volume successfully. Jul 06 12:31:41 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 1073741824" returned: 0 in 0.875s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:41 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 Jul 06 12:31:41 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:41 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5" returned: 0 in 0.640s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.295s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-318404691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0aae9e-9a2a-41e4-9934-eacf116b0451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:32Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Creating volume 3b0aae9e-9a2a-41e4-9934-eacf116b0451 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:41 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:41 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 1073741824 Jul 06 12:31:41 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eb9fde-8ed9-4e82-8142-9b15091d9725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926dda87-2602-49c9-9127-234bbda52df5', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05307e1a-a1a2-4410-bcb6-8bc31761392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:41 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Volume volume-926dda87-2602-49c9-9127-234bbda52df5 (926dda87-2602-49c9-9127-234bbda52df5): created successfully Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05307e1a-a1a2-4410-bcb6-8bc31761392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Flow 'volume_create_manager' (a90aefb9-1fde-4c21-b1d0-217c7521efd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f6742639-5142-4f89-b627-03412f53b138 tempest-CreateVolumesFromImageTest-359790364 None] Created volume successfully. Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-926dda87-2602-49c9-9127-234bbda52df5-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-926dda87-2602-49c9-9127-234bbda52df5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-quobyte-926dda87-2602-49c9-9127-234bbda52df5" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-926dda87-2602-49c9-9127-234bbda52df5" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd18307-fabf-4ee4-8850-250368bc73ba]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:42 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 Jul 06 12:31:42 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:42 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 1073741824" returned: 0 in 0.868s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:42 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 Jul 06 12:31:42 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:43 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5" returned: 0 in 0.791s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:43 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5 Jul 06 12:31:43 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:43 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451" returned: 0 in 0.653s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.481s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369014627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687658b4-ba28-42ec-9459-f3dc0ea80070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:33Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Creating volume 687658b4-ba28-42ec-9459-f3dc0ea80070 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:43 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:43 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 1073741824 Jul 06 12:31:43 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11108528-89be-4942-bacd-8d68ea5fbe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4630ae9-3fce-480e-9465-8993b3c7326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:43 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 (3b0aae9e-9a2a-41e4-9934-eacf116b0451): created successfully Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4630ae9-3fce-480e-9465-8993b3c7326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (9b86633b-bb10-4859-bf34-00755d68617e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:43 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-da168153-95c5-4702-b905-fbc9827320ce tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created volume successfully. Jul 06 12:31:43 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-926dda87-2602-49c9-9127-234bbda52df5" returned: 0 in 0.673s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-926dda87-2602-49c9-9127-234bbda52df5" released by "delete_volume" :: held 1.507s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Created reservations ['c018f02d-80f7-45fa-a58b-963235e1fb79', '334dc3de-510f-480b-b5fa-1fcc657aa33e', '80364830-4e22-4a91-b118-37c5c8acc430', 'bbb3d199-3ba1-483e-adc8-7e63a04d594f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:43 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:43 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:44 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 1073741824" returned: 0 in 0.977s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-quobyte-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:44 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 Jul 06 12:31:44 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19b868-83a9-4db2-982e-e6706813d69b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:44 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.755s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Deleted volume successfully. Jul 06 12:31:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a3286803-59a8-4e71-b9b2-e7a76e9a1ddf tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-926dda87-2602-49c9-9127-234bbda52df5-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:44 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 Jul 06 12:31:44 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:45 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070" returned: 0 in 0.701s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.671s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496485918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1490f1f-a712-4ac4-89f5-419668d688ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:33Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Creating volume a1490f1f-a712-4ac4-89f5-419668d688ec {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:45 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b402190c-1898-4d1d-9a37-cdcced882387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687658b4-ba28-42ec-9459-f3dc0ea80070', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:45 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec 1073741824 Jul 06 12:31:45 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5a6260-e0d0-4d1a-bea3-ebd7146349b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:45 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume volume-687658b4-ba28-42ec-9459-f3dc0ea80070 (687658b4-ba28-42ec-9459-f3dc0ea80070): created successfully Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5a6260-e0d0-4d1a-bea3-ebd7146349b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (9e33c00c-d645-4e63-a309-e5cd76298d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:45 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-bcb95641-2c7d-409e-80a6-a3f325e8fe41 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created volume successfully. Jul 06 12:31:45 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4" returned: 0 in 0.779s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:45 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4 Jul 06 12:31:45 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:46 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4" returned: 0 in 0.670s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4" released by "delete_volume" :: held 1.496s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:46 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec 1073741824" returned: 0 in 0.880s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Created reservations ['ab3b52c2-39f9-412b-a60a-ea03c5520c9d', '2ce6156c-9d02-4627-9930-21eef71c576f', '79c90dba-8bc0-49e4-8912-6fd55eb454a1', 'bcecc8e0-67a5-49e4-b672-4dfd746f4870'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:46 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec Jul 06 12:31:46 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:46 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:46 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-da6eb512-c8f9-4972-9ce9-dfea7346860d-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-da6eb512-c8f9-4972-9ce9-dfea7346860d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-quobyte-da6eb512-c8f9-4972-9ce9-dfea7346860d" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-da6eb512-c8f9-4972-9ce9-dfea7346860d" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c390f03f-5615-49d6-bc74-9763a9e3d73d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:46 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec" returned: 0 in 0.712s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.755s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537396815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982d1387-a979-434b-9ae5-3978db881137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:34Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Creating volume 982d1387-a979-434b-9ae5-3978db881137 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:46 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:46 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8644bd47-0956-46b0-8650-ef13908a95fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1490f1f-a712-4ac4-89f5-419668d688ec', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce695cb0-b159-4541-a267-4645939167d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:46 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 1073741824 Jul 06 12:31:46 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.708s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Deleted volume successfully. Jul 06 12:31:46 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume volume-a1490f1f-a712-4ac4-89f5-419668d688ec (a1490f1f-a712-4ac4-89f5-419668d688ec): created successfully Jul 06 12:31:46 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d Jul 06 12:31:46 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce695cb0-b159-4541-a267-4645939167d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (483f0c0d-8499-4bad-a4a4-dc3ccf9e5967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-277fe9c6-ecd8-4436-8a5d-a58e734769ac tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created volume successfully. Jul 06 12:31:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-e524af99-8a2e-46d1-9351-b6df663f0980 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-e7b56dd8-ab28-42ea-a9c9-47faf2cee2e4-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:47 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d" returned: 0 in 0.785s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:47 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d Jul 06 12:31:47 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:47 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 1073741824" returned: 0 in 0.882s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:47 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 Jul 06 12:31:47 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:48 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-da6eb512-c8f9-4972-9ce9-dfea7346860d" returned: 0 in 0.663s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-da6eb512-c8f9-4972-9ce9-dfea7346860d" released by "delete_volume" :: held 1.489s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Created reservations ['13d91237-64c6-4b05-9440-76827372390d', '3152a06a-ccbe-433d-b156-23f99ba52247', '7004b6ee-28d4-436a-96c8-c9f53cafa754', 'cd37b4bd-c2fb-4ee2-a347-3e0aaae1bdf7'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:48 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:48 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:48 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137" returned: 0 in 0.664s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.892s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305668163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36d7488-919a-4c00-bdc5-f29231bab766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e045928b9c0f4d75975ce1ef52b99dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:34Z,use_quota=True,user_id='16ed3a5809124c929643ffea3c6eed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Creating volume b36d7488-919a-4c00-bdc5-f29231bab766 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:48 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8f03c4-fda8-4a90-93e8-88f442a1ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982d1387-a979-434b-9ae5-3978db881137', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:48 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 1073741824 Jul 06 12:31:48 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7450926b-7d06-4df5-88f0-91b3111a9382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:48 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume volume-982d1387-a979-434b-9ae5-3978db881137 (982d1387-a979-434b-9ae5-3978db881137): created successfully Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7450926b-7d06-4df5-88f0-91b3111a9382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (f798ec64-f5e4-4cb5-9475-7f71f1ebe935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-09a92a73-7256-4012-afac-09dd6385cd7b tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created volume successfully. Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-68a3a88c-e320-4880-8f81-fc4e249951b3-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-68a3a88c-e320-4880-8f81-fc4e249951b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-quobyte-68a3a88c-e320-4880-8f81-fc4e249951b3" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-68a3a88c-e320-4880-8f81-fc4e249951b3" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb3bc84-b43e-40df-8734-61eb64f7be10]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:49 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.732s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Deleted volume successfully. Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-587fec2b-32cf-407f-ad69-2f4032ce5347 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-da6eb512-c8f9-4972-9ce9-dfea7346860d-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:49 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 Jul 06 12:31:49 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:49 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 1073741824" returned: 0 in 0.919s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:49 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 Jul 06 12:31:49 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:49 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3" returned: 0 in 0.819s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:49 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3 Jul 06 12:31:49 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:50 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766" returned: 0 in 0.690s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.214s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0a26b1-ea76-4ec8-a5da-36c739b1f440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c378e0d8811426ebc142c8b25ffee0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:34Z,use_quota=True,user_id='412ac39d0bee491aa1a6e5ddc60e2a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(910bb5d9-ca28-41a9-8981-286671e31d28),volume_type_id=910bb5d9-ca28-41a9-8981-286671e31d28)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Creating volume be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:50 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:50 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 1073741824 Jul 06 12:31:50 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69688dbf-049d-4a24-a1e0-585d95c0b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36d7488-919a-4c00-bdc5-f29231bab766', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6cb398-9292-41c9-8f3a-d723b83411d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:50 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Volume volume-b36d7488-919a-4c00-bdc5-f29231bab766 (b36d7488-919a-4c00-bdc5-f29231bab766): created successfully Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6cb398-9292-41c9-8f3a-d723b83411d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Flow 'volume_create_manager' (3e2dc62f-bc0d-46b9-93d6-3296c669f71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d150ffea-e62a-4983-af48-f666b93a1e44 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created volume successfully. Jul 06 12:31:50 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-68a3a88c-e320-4880-8f81-fc4e249951b3" returned: 0 in 0.668s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-68a3a88c-e320-4880-8f81-fc4e249951b3" released by "delete_volume" :: held 1.545s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Created reservations ['6be5d339-05fc-45b1-b8c8-dfe4c71e0fa6', 'faf62ea3-27d2-4502-a4bc-279526dc2677', '3d1ce922-7556-452c-af4a-582b92f1ee08', 'f4590707-86e2-4e5b-98d3-dc4b1985e3ad'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-b36d7488-919a-4c00-bdc5-f29231bab766-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:50 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:50 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-b36d7488-919a-4c00-bdc5-f29231bab766-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-quobyte-b36d7488-919a-4c00-bdc5-f29231bab766" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-b36d7488-919a-4c00-bdc5-f29231bab766" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a130e-50f6-4d08-8334-93ae0c7df2bf]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:50 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 Jul 06 12:31:50 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:51 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 1073741824" returned: 0 in 0.924s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:51 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 Jul 06 12:31:51 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-1651220b-c249-4e6e-a448-2a3238f09e35-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-1651220b-c249-4e6e-a448-2a3238f09e35-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "cinder-quobyte-1651220b-c249-4e6e-a448-2a3238f09e35" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-1651220b-c249-4e6e-a448-2a3238f09e35" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d946b0-7840-4129-b5c5-d560ce9ee21a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:51 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.717s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Deleted volume successfully. Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-96072023-6d60-48a4-840c-e3dc2b189943 tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-68a3a88c-e320-4880-8f81-fc4e249951b3-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:51 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 Jul 06 12:31:51 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:51 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766" returned: 0 in 0.865s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:51 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766 Jul 06 12:31:51 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:51 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440" returned: 0 in 0.840s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.468s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Creating offline snapshot b674799c-d11a-4c8a-940c-897881a0bd37 of volume a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96bcc70-6479-4bc8-abcf-11b4c9d092ab]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:51 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Attempting download of eb23a098-901b-4582-8d16-94e59510c229 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb23a098-901b-4582-8d16-94e59510c229', 'metadata': {}}])) to volume be0a26b1-ea76-4ec8-a5da-36c739b1f440. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5545173-0242-437f-850d-2752ddbb03c1]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb23a098-901b-4582-8d16-94e59510c229_rurgc7lg {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:52 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 Jul 06 12:31:52 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:52 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb23a098-901b-4582-8d16-94e59510c229_rurgc7lg Jul 06 12:31:52 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:52 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35" returned: 0 in 0.865s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:52 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35 Jul 06 12:31:52 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:52 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b36d7488-919a-4c00-bdc5-f29231bab766" returned: 0 in 0.773s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-b36d7488-919a-4c00-bdc5-f29231bab766" released by "delete_volume" :: held 1.692s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created reservations ['644f443e-1990-4e32-bfae-27e7cadcc673', 'c868bf5c-8674-4778-9191-8b4954fb77cb', '8c61c26c-172e-46e5-badf-a0d2e65b0e6b', '365f2f58-b2a8-4344-a992-a723e9c52ef8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:52 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:52 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:52 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573" returned: 0 in 0.895s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:52 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 1G Jul 06 12:31:52 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:52 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb23a098-901b-4582-8d16-94e59510c229_rurgc7lg" returned: 0 in 0.894s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb23a098-901b-4582-8d16-94e59510c229_rurgc7lg {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-982d1387-a979-434b-9ae5-3978db881137-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:53 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1651220b-c249-4e6e-a448-2a3238f09e35" returned: 0 in 0.832s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-982d1387-a979-434b-9ae5-3978db881137-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-quobyte-1651220b-c249-4e6e-a448-2a3238f09e35" released by "delete_volume" :: held 1.779s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:53 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb23a098-901b-4582-8d16-94e59510c229_rurgc7lg Jul 06 12:31:53 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-quobyte-982d1387-a979-434b-9ae5-3978db881137" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-982d1387-a979-434b-9ae5-3978db881137" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Created reservations ['48242875-1699-4fb6-a80f-74840c3a4f58', 'b93e711b-1a4c-4bb4-8d46-9f4559ded7aa', '7c89ed73-2107-4a60-95dc-ea80828a23fa', '365ebcc9-707c-47d2-ad75-4cc7a08950e0'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d284c17-f5d5-4fb6-ba32-f0f21ceb264a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:53 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 Jul 06 12:31:53 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:53 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:53 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:53 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.868s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Deleted volume successfully. Jul 06 12:31:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-faddb8a0-1c0a-41d3-90e6-4e70126d8d58 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-b36d7488-919a-4c00-bdc5-f29231bab766-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:54 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb23a098-901b-4582-8d16-94e59510c229_rurgc7lg" returned: 1 in 1.086s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb23a098-901b-4582-8d16-94e59510c229_rurgc7lg' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[836b881d-e77f-4245-b2fb-053c5d629f25]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:54 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 1G" returned: 0 in 1.224s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a97635db-b1e1-4407-9ec3-35841e301573 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:54 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a97635db-b1e1-4407-9ec3-35841e301573 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 Jul 06 12:31:54 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:54 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD Jul 06 12:31:54 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:54 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.973s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:54 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Deleted volume successfully. Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b13eb830-24d4-46d1-ace0-7ec4f016bdfd tempest-CreateVolumesFromImageTest-359790364 None] Lock "cinder-1651220b-c249-4e6e-a448-2a3238f09e35-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:54 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137" returned: 0 in 1.233s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:54 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137 Jul 06 12:31:54 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:54 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a97635db-b1e1-4407-9ec3-35841e301573 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37" returned: 0 in 0.846s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:54 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 is being set with open permissions: ugo+rw Jul 06 12:31:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:54 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 Jul 06 12:31:54 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:54 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD" returned: 0 in 0.945s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:55 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD Jul 06 12:31:55 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:55 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-982d1387-a979-434b-9ae5-3978db881137" returned: 0 in 0.928s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-982d1387-a979-434b-9ae5-3978db881137" released by "delete_volume" :: held 2.221s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created reservations ['399fc8d3-9379-48d5-9a1a-2185c1b183d2', '562d2bea-0446-4e02-b2de-a647a933f08b', 'ce4b009c-8ea1-4f0c-9977-14b2c06c8a86', 'f1886351-1176-4e4f-b3e6-1889b77daf4f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:55 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:55 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:55 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37" returned: 0 in 0.884s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:55 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.info Jul 06 12:31:55 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:55 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD" returned: 1 in 0.958s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] eb23a098-901b-4582-8d16-94e59510c229 was raw, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:31:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:56 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 Jul 06 12:31:56 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:56 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.740s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Deleted volume successfully. Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-cf62a7dc-796d-4305-a35b-dd45f0ee1ac3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-982d1387-a979-434b-9ae5-3978db881137-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-a1490f1f-a712-4ac4-89f5-419668d688ec-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-a1490f1f-a712-4ac4-89f5-419668d688ec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-quobyte-a1490f1f-a712-4ac4-89f5-419668d688ec" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-a1490f1f-a712-4ac4-89f5-419668d688ec" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90fd125-fe27-43bc-a075-b5f539886425]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:56 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.info" returned: 0 in 0.880s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:56 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.info is being set with open permissions: ugo+rw Jul 06 12:31:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:56 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec Jul 06 12:31:56 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:56 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.info Jul 06 12:31:56 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:57 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440" returned: 0 in 1.048s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb23a098-901b-4582-8d16-94e59510c229_tm54q01tdevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:31:57 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:57 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 1G Jul 06 12:31:57 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:57 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.info" returned: 0 in 0.764s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.606s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:57 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec" returned: 0 in 0.952s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-84210210-3f34-437f-b0b8-e0ee74e882a2 tempest-VolumeDependencyTests-2119557014 None] Create snapshot completed successfully Jul 06 12:31:57 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec Jul 06 12:31:57 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:57 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 1G" returned: 0 in 0.931s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43f9851-a836-4827-9c13-952aa69d4289]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:58 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 Jul 06 12:31:58 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:58 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a1490f1f-a712-4ac4-89f5-419668d688ec" returned: 0 in 0.701s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-a1490f1f-a712-4ac4-89f5-419668d688ec" released by "delete_volume" :: held 1.716s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created reservations ['66ca6414-978d-4715-b951-e40c5d7e6e47', '5f9bcb3d-0a19-496f-80b5-8fa13653c256', '67c3cb4e-10fd-4e58-9c2a-7ed1136f85ac', '84b38ec3-11bb-43ca-bae2-daeda80db7c2'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:58 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:31:58 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-687658b4-ba28-42ec-9459-f3dc0ea80070-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-687658b4-ba28-42ec-9459-f3dc0ea80070-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-quobyte-687658b4-ba28-42ec-9459-f3dc0ea80070" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-687658b4-ba28-42ec-9459-f3dc0ea80070" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4ae559-442c-431f-b00f-f217f39edd73]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:59 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440" returned: 0 in 1.087s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:59 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 Jul 06 12:31:59 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:59 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 Jul 06 12:31:59 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Flow 'volume_create_manager' (ec88fa35-1e01-4d0c-b0d3-56d60c927dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2cc217-36c2-460c-b547-a558425f2ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2cc217-36c2-460c-b547-a558425f2ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1441312880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c17a86-ccb1-47df-b36e-43696a8172d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c042f4a0ac304ebb8a8b92ffa15eaf70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b674799c-d11a-4c8a-940c-897881a0bd37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:59Z,use_quota=True,user_id='7c7edcd557b44851a7138a06ac107f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d928429-63dd-4a56-8514-e900b80f20b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d928429-63dd-4a56-8514-e900b80f20b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a37b7f-0fec-48ad-a9b7-5e69f0c3fba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a37b7f-0fec-48ad-a9b7-5e69f0c3fba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69c17a86-ccb1-47df-b36e-43696a8172d2', 'volume_name': 'volume-69c17a86-ccb1-47df-b36e-43696a8172d2', 'volume_size': 1, 'snapshot_id': 'b674799c-d11a-4c8a-940c-897881a0bd37'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fd2ddf-e640-4d7f-b763-f71e82747fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fd2ddf-e640-4d7f-b763-f71e82747fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a2b5cc-ae52-4df9-9f40-2d749837a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:59 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Volume 69c17a86-ccb1-47df-b36e-43696a8172d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69c17a86-ccb1-47df-b36e-43696a8172d2', 'volume_size': 1, 'snapshot_id': 'b674799c-d11a-4c8a-940c-897881a0bd37'} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-quobyte-b674799c-d11a-4c8a-940c-897881a0bd37-69c17a86-ccb1-47df-b36e-43696a8172d2" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-b674799c-d11a-4c8a-940c-897881a0bd37-69c17a86-ccb1-47df-b36e-43696a8172d2" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Creating volume 69c17a86-ccb1-47df-b36e-43696a8172d2 from snapshot b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-quobyte-69c17a86-ccb1-47df-b36e-43696a8172d2" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-69c17a86-ccb1-47df-b36e-43696a8172d2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] snapshot: b674799c-d11a-4c8a-940c-897881a0bd37, volume: 69c17a86-ccb1-47df-b36e-43696a8172d2, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:59 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d2dfe9-9fec-41f5-8acb-cc4e82439bff]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.006s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Deleted volume successfully. Jul 06 12:31:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2deb1d32-ef9b-47d1-8a58-d9c60ece49a3 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-a1490f1f-a712-4ac4-89f5-419668d688ec-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:31:59 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 Jul 06 12:31:59 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:00 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440" returned: 1 in 1.055s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Downloaded image eb23a098-901b-4582-8d16-94e59510c229 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb23a098-901b-4582-8d16-94e59510c229', 'metadata': {}}])) to volume be0a26b1-ea76-4ec8-a5da-36c739b1f440 successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Temporary image eb23a098-901b-4582-8d16-94e59510c229 for user 412ac39d0bee491aa1a6e5ddc60e2a6b is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Marking volume be0a26b1-ea76-4ec8-a5da-36c739b1f440 as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:32:00 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070" returned: 0 in 1.129s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Copying metadata from image eb23a098-901b-4582-8d16-94e59510c229 to be0a26b1-ea76-4ec8-a5da-36c739b1f440. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Creating volume glance metadata for volume be0a26b1-ea76-4ec8-a5da-36c739b1f440 backed by image eb23a098-901b-4582-8d16-94e59510c229 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'eb23a098-901b-4582-8d16-94e59510c229', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '09eacd6b9bc1fce872685a50f2d6f525', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:32:00 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070 Jul 06 12:32:00 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54127f81-325e-45c7-9bd4-cfc510871b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440', 'volume_size': 1, 'image_id': 'eb23a098-901b-4582-8d16-94e59510c229', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb23a098-901b-4582-8d16-94e59510c229', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09eacd6b9bc1fce872685a50f2d6f525', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c378e0d8811426ebc142c8b25ffee0b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97dba251a140799f9753bd839ec27050df0fba8f1e999f562b8ebba8987458f5514677767a832825d23b7610218345c018ba31d3d8b4117120da82fa93c4eaa1', 'id': 'eb23a098-901b-4582-8d16-94e59510c229', 'created_at': datetime.datetime(2026, 7, 6, 10, 31, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 31, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb23a098-901b-4582-8d16-94e59510c229/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9ab761-50e0-4bea-94df-505d87203a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:00 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Volume volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 (be0a26b1-ea76-4ec8-a5da-36c739b1f440): created successfully Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9ab761-50e0-4bea-94df-505d87203a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Flow 'volume_create_manager' (47fabf60-0d0e-415b-b5cf-6af628c33ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:00 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ee88dfae-4609-4fa9-9fa1-a90428936460 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Created volume successfully. Jul 06 12:32:00 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37" returned: 0 in 0.899s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a97635db-b1e1-4407-9ec3-35841e301573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[15704469-c065-4031-8ce7-803cdce93c51]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:00 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 Jul 06 12:32:00 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Acquiring lock "cinder-be0a26b1-ea76-4ec8-a5da-36c739b1f440-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "cinder-be0a26b1-ea76-4ec8-a5da-36c739b1f440-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Acquiring lock "cinder-quobyte-be0a26b1-ea76-4ec8-a5da-36c739b1f440" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "cinder-quobyte-be0a26b1-ea76-4ec8-a5da-36c739b1f440" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9592cf3a-808b-4b9f-bdcb-5811041f6145]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:01 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-687658b4-ba28-42ec-9459-f3dc0ea80070" returned: 0 in 0.879s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-687658b4-ba28-42ec-9459-f3dc0ea80070" released by "delete_volume" :: held 2.097s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:01 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 Jul 06 12:32:01 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created reservations ['5d35d5c1-5abb-4453-b711-f1791ff90061', '2c14c2a2-1266-4c74-ba81-b73a884dcc99', 'a875b496-06dc-488d-94d2-ee1a8619e07b', 'a7a31857-96f6-4ecf-a10f-2a0866e6fa9e'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Flow 'volume_create_manager' (d3b2245a-807b-4ae3-8b50-5fc0d5996940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e29628-72bf-4c2e-84e4-014788231477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e29628-72bf-4c2e-84e4-014788231477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0faa622-88c1-48dd-8450-9fa649876d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55229d0924454cd8a4d94f9792377183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:01Z,use_quota=True,user_id='d998fcc304d8433dbaff04dbc7149046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39b2941-b236-4699-b701-5dbb2489918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39b2941-b236-4699-b701-5dbb2489918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056f6925-9132-4a70-87a5-792e4009a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.image.glance [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Creating Keystone auth plugin from conf {{(pid=86706) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:32:01 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573" returned: 0 in 0.940s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:01 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 Jul 06 12:32:01 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:01 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:01 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056f6925-9132-4a70-87a5-792e4009a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0faa622-88c1-48dd-8450-9fa649876d31', 'volume_name': 'volume-b0faa622-88c1-48dd-8450-9fa649876d31', 'volume_size': 1, 'image_id': 'd3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94cdeeadfec03725e95f23681e01beaa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55229d0924454cd8a4d94f9792377183', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d22c8dc1972b350e9fab7edfe7af221369a18378a1aa97b64cec7ea38fd12fa114e638e47dc7715740d21ba8902131766b697d495e0c986a03ffa747a37c76e', 'id': 'd3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'created_at': datetime.datetime(2026, 7, 6, 10, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d/file', 'properties': {}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb222a1-b658-406e-b416-c1391bf0ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb222a1-b658-406e-b416-c1391bf0ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d9a03-5ea2-496a-815d-cc28e7777c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:01 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Volume b0faa622-88c1-48dd-8450-9fa649876d31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0faa622-88c1-48dd-8450-9fa649876d31', 'volume_size': 1, 'image_id': 'd3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94cdeeadfec03725e95f23681e01beaa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55229d0924454cd8a4d94f9792377183', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d22c8dc1972b350e9fab7edfe7af221369a18378a1aa97b64cec7ea38fd12fa114e638e47dc7715740d21ba8902131766b697d495e0c986a03ffa747a37c76e', 'id': 'd3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'created_at': datetime.datetime(2026, 7, 6, 10, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d/file', 'properties': {}}, 'image_service': } Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Trying to clone b0faa622-88c1-48dd-8450-9fa649876d31 from image d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'metadata': {}}]). {{(pid=86706) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:32:01 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b4ec67-6b59-482d-b3df-825370fd2c19]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:01 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD Jul 06 12:32:01 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:01 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440" returned: 0 in 1.031s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:02 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.740s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Deleted volume successfully. Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-019efb92-5d90-49f3-ac75-5970d614972a tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-687658b4-ba28-42ec-9459-f3dc0ea80070-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:02 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 Jul 06 12:32:02 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-3b0aae9e-9a2a-41e4-9934-eacf116b0451-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-3b0aae9e-9a2a-41e4-9934-eacf116b0451-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-quobyte-3b0aae9e-9a2a-41e4-9934-eacf116b0451" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-3b0aae9e-9a2a-41e4-9934-eacf116b0451" acquired by "delete_volume" :: waited 0.061s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0328792-4ddd-42c0-a5d5-5b67dee4c148]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:02 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD" returned: 0 in 1.207s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:03 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 Jul 06 12:32:03 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:03 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD Jul 06 12:32:03 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:04 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440" returned: 1 in 2.390s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:04 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440 Jul 06 12:32:04 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:04 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD" returned: 1 in 1.857s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:04 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Temporary image d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d is fetched for user d998fcc304d8433dbaff04dbc7149046. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:32:05 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[746a3577-1b7e-45fb-98f8-405ed74ab6eb]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:05 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451" returned: 0 in 2.462s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:05 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451 Jul 06 12:32:05 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:05 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD Jul 06 12:32:05 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:05 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-be0a26b1-ea76-4ec8-a5da-36c739b1f440" returned: 0 in 1.590s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "cinder-quobyte-be0a26b1-ea76-4ec8-a5da-36c739b1f440" released by "delete_volume" :: held 5.129s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Created reservations ['4a0db13e-1a7c-44d1-aa07-57b59acd64d2', '69accbf8-d636-484f-b2f5-999428e88106', 'c5c7f8fc-fdda-4b70-b2dc-2a1b2e102666', '19cb56f1-88ed-4602-8731-750f80260411'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:06 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:06 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:06 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD" returned: 0 in 1.758s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:07 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b0aae9e-9a2a-41e4-9934-eacf116b0451" returned: 0 in 2.002s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:07 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD Jul 06 12:32:07 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-3b0aae9e-9a2a-41e4-9934-eacf116b0451" released by "delete_volume" :: held 4.589s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created reservations ['92c0ddea-9107-40ea-b0ce-af45daae5cb2', 'f80b5e13-e0e1-4743-8940-78cdba5928bf', '8dbee634-b58f-4be4-9d48-79b66ee093cc', 'af7693ce-6e4c-425f-a5b4-f0842f339657'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:07 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:07 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:08 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.551s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Deleted volume successfully. Jul 06 12:32:08 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2" returned: 0 in 6.675s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-fb9ea383-4caf-49b0-aee6-a4f1808e4a37 tempest-VolumeAndVolumeTypeFromImageTest-2092278046 None] Lock "cinder-be0a26b1-ea76-4ec8-a5da-36c739b1f440-delete_volume" released by "delete_volume" :: held 7.287s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad597e5b-711e-42f4-9669-8bfc98eafe0a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:08 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 Jul 06 12:32:08 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:08 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD" returned: 1 in 1.490s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:08 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.786s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Deleted volume successfully. Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-991b8247-6c88-4cbd-a075-d1774b25b175 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-3b0aae9e-9a2a-41e4-9934-eacf116b0451-delete_volume" released by "delete_volume" :: held 6.151s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-43a853c0-6552-40a7-9985-870a0b70b17c-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-43a853c0-6552-40a7-9985-870a0b70b17c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "cinder-quobyte-43a853c0-6552-40a7-9985-870a0b70b17c" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-43a853c0-6552-40a7-9985-870a0b70b17c" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7ab7aa-7a87-4dbf-8f12-cba3cb893c20]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:09 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c Jul 06 12:32:09 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:09 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573" returned: 0 in 1.155s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:09 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:32:09 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Converted 1024.00 MB image at 153.32 MB/s Jul 06 12:32:09 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 is being set with open permissions: ugo+rw Jul 06 12:32:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:09 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 Jul 06 12:32:09 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:09 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c" returned: 0 in 0.934s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:09 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c Jul 06 12:32:09 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:09 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-69c17a86-ccb1-47df-b36e-43696a8172d2" released by "_copy_volume_from_snapshot" :: held 10.607s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-b674799c-d11a-4c8a-940c-897881a0bd37-69c17a86-ccb1-47df-b36e-43696a8172d2" released by "_create_volume_from_snapshot" :: held 10.643s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.659s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.613s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0faa622-88c1-48dd-8450-9fa649876d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55229d0924454cd8a4d94f9792377183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:01Z,use_quota=True,user_id='d998fcc304d8433dbaff04dbc7149046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Creating volume b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:10 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:10 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 1073741824 Jul 06 12:32:10 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a2b5cc-ae52-4df9-9f40-2d749837a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c17a86-ccb1-47df-b36e-43696a8172d2', 'volume_size': 1, 'snapshot_id': 'b674799c-d11a-4c8a-940c-897881a0bd37'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c70ffda-7ba9-405b-8899-8b8410e395c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:10 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Volume volume-69c17a86-ccb1-47df-b36e-43696a8172d2 (69c17a86-ccb1-47df-b36e-43696a8172d2): created successfully Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c70ffda-7ba9-405b-8899-8b8410e395c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Flow 'volume_create_manager' (ec88fa35-1e01-4d0c-b0d3-56d60c927dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:10 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f2c0157b-a069-40d1-a8fc-ac2abf5516b9 tempest-VolumeDependencyTests-2119557014 None] Created volume successfully. Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-b674799c-d11a-4c8a-940c-897881a0bd37-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-b674799c-d11a-4c8a-940c-897881a0bd37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-quobyte-a97635db-b1e1-4407-9ec3-35841e301573" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-a97635db-b1e1-4407-9ec3-35841e301573" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-quobyte-b674799c-d11a-4c8a-940c-897881a0bd37" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-b674799c-d11a-4c8a-940c-897881a0bd37" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Deleting offline snapshot b674799c-d11a-4c8a-940c-897881a0bd37 of volume a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] snapshot_file for this snap is: volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f9a203-8388-4a02-b948-13575ca42a8e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:10 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-43a853c0-6552-40a7-9985-870a0b70b17c" returned: 0 in 0.819s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-quobyte-43a853c0-6552-40a7-9985-870a0b70b17c" released by "delete_volume" :: held 1.813s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Created reservations ['64798682-721d-4bdc-bf69-5d92505b86e1', '63e0cdd2-b7db-4098-b594-0c96e880364e', 'dc415583-b552-47b3-bc32-6b17bb6696f3', 'e8bf1120-7442-46d3-b0c1-2a79c470c5b4'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:10 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 Jul 06 12:32:10 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:10 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:10 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:11 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 1073741824" returned: 0 in 1.520s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:11 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 Jul 06 12:32:11 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:11 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.955s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:11 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Deleted volume successfully. Jul 06 12:32:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4184546f-dbda-48b6-970d-35e2b32cab34 tempest-CreateVolumesFromSourceVolumeTest-1176597237 None] Lock "cinder-43a853c0-6552-40a7-9985-870a0b70b17c-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:11 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37" returned: 0 in 1.335s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a97635db-b1e1-4407-9ec3-35841e301573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f63002-1bd1-4d40-994a-02eb5ccc4ee0]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:12 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 Jul 06 12:32:12 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:12 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31" returned: 0 in 0.959s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] <== create_volume: return (2560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.564s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Attempting download of d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d ((None, [{'url': 'file:///opt/stack/data/glance/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'metadata': {}}])) to volume b0faa622-88c1-48dd-8450-9fa649876d31. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e3cacf-683a-4b69-9afb-55270f12d4da]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_0l3j859g {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:12 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_0l3j859g Jul 06 12:32:12 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:13 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573" returned: 0 in 1.075s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:13 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 Jul 06 12:32:13 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:13 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (c95ea92b-fcb2-4d1a-810f-cf1692393094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24ffe8f-1e51-4e70-a940-c1e250e2bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_0l3j859g" returned: 0 in 0.919s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_0l3j859g {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24ffe8f-1e51-4e70-a940-c1e250e2bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1678408340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc40ef3-04bc-49e8-b679-3f1b8d9c6653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:14Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2570e06-a25c-4a2a-80ca-24254b56ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2570e06-a25c-4a2a-80ca-24254b56ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac14d7b-9690-448f-b546-80c5fda91b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac14d7b-9690-448f-b546-80c5fda91b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc40ef3-04bc-49e8-b679-3f1b8d9c6653', 'volume_name': 'volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d5ab67-18d6-41fa-826e-162f56e8d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d5ab67-18d6-41fa-826e-162f56e8d90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2ed8bd-7e20-4218-9836-6fba452b3266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:13 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume 5fc40ef3-04bc-49e8-b679-3f1b8d9c6653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653', 'volume_size': 1} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1678408340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc40ef3-04bc-49e8-b679-3f1b8d9c6653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:14Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Creating volume 5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:13 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:13 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 1073741824 Jul 06 12:32:13 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:13 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_0l3j859g Jul 06 12:32:13 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:14 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37" returned: 0 in 0.922s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:14 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37 Jul 06 12:32:14 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:14 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_0l3j859g" returned: 1 in 0.936s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_0l3j859g' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[01be8b61-61a2-4d8b-a01f-32b0ed6bfa34]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:14 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD Jul 06 12:32:14 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:14 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 1073741824" returned: 0 in 1.016s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:14 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573.b674799c-d11a-4c8a-940c-897881a0bd37" returned: 0 in 0.807s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:14 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 Jul 06 12:32:14 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-b674799c-d11a-4c8a-940c-897881a0bd37" released by "_delete_snapshot" :: held 4.296s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:14 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-a97635db-b1e1-4407-9ec3-35841e301573" released by "delete_snapshot" :: held 4.329s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Created reservations ['6ce893be-cb21-4c34-bfdc-af1ec4d1a541', '4e3e4c4c-8b1d-4f35-bac6-800dd97d3ebb', 'fa06a02c-0adc-4ab3-8541-277c9d5dc88a', '2d50c549-3744-4570-9c83-02e111ffa07b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:15 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Delete snapshot completed successfully. Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3dea01a4-8c7d-4bbe-b1c8-c90fdada1a02 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-b674799c-d11a-4c8a-940c-897881a0bd37-delete_snapshot" released by "delete_snapshot" :: held 4.532s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:15 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD" returned: 0 in 0.848s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:15 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD Jul 06 12:32:15 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:15 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" returned: 0 in 0.850s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2ed8bd-7e20-4218-9836-6fba452b3266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1abbbe3-31e3-450a-8905-c1cd27414dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:15 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 (5fc40ef3-04bc-49e8-b679-3f1b8d9c6653): created successfully Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1abbbe3-31e3-450a-8905-c1cd27414dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (c95ea92b-fcb2-4d1a-810f-cf1692393094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:15 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-de4b4b4c-c4a4-470f-8180-33c796520a93 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created volume successfully. Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-a97635db-b1e1-4407-9ec3-35841e301573-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-a97635db-b1e1-4407-9ec3-35841e301573-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-quobyte-a97635db-b1e1-4407-9ec3-35841e301573" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-a97635db-b1e1-4407-9ec3-35841e301573" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1883a3fa-8959-47cf-bb69-c16958aa8f55]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:16 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 Jul 06 12:32:16 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:16 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD" returned: 1 in 0.856s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:16 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d was raw, converting to raw {{(pid=86706) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:32:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:16 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 Jul 06 12:32:16 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:17 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573" returned: 0 in 1.017s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:17 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573 Jul 06 12:32:17 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Creating offline snapshot 577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a of volume 5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a50082-c393-43a0-8115-353a3b91cff8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:17 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31" returned: 0 in 0.898s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d_27ljkw_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:32:17 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:17 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 1G Jul 06 12:32:17 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:17 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 Jul 06 12:32:17 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:17 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a97635db-b1e1-4407-9ec3-35841e301573" returned: 0 in 0.835s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-a97635db-b1e1-4407-9ec3-35841e301573" released by "delete_volume" :: held 1.916s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:17 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Created reservations ['821bb3fc-d825-4c9a-96a8-5403d0a2875f', 'dc921852-2d10-4ed3-9fd8-43c99da23c86', 'b140dab1-9217-42b0-865a-5a87895772a2', '18379e8a-5765-4f00-a9b0-7b411e95298a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:18 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" returned: 0 in 0.937s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:18 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:18 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 1G" returned: 0 in 0.912s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:18 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:18 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a 1G Jul 06 12:32:18 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d13736-88a2-4025-92cd-e3b0b6eb0585]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-69c17a86-ccb1-47df-b36e-43696a8172d2-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-69c17a86-ccb1-47df-b36e-43696a8172d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "cinder-quobyte-69c17a86-ccb1-47df-b36e-43696a8172d2" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-69c17a86-ccb1-47df-b36e-43696a8172d2" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:18 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 Jul 06 12:32:18 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1902e592-d350-4e59-94ba-cab3981cada7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:18 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 Jul 06 12:32:18 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:18 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.782s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Deleted volume successfully. Jul 06 12:32:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3a58de01-2b6f-4536-976b-5db60ddcb3f5 tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-a97635db-b1e1-4407-9ec3-35841e301573-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:19 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31" returned: 0 in 0.982s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:19 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a 1G" returned: 0 in 1.196s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:19 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 Jul 06 12:32:19 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:19 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a Jul 06 12:32:19 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:19 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2" returned: 0 in 1.079s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:19 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2 Jul 06 12:32:19 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:20 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31" returned: 1 in 0.876s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Downloaded image d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d ((None, [{'url': 'file:///opt/stack/data/glance/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'metadata': {}}])) to volume b0faa622-88c1-48dd-8450-9fa649876d31 successfully. {{(pid=86706) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Temporary image d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d for user d998fcc304d8433dbaff04dbc7149046 is deleted. {{(pid=86706) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.volume_utils [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Marking volume b0faa622-88c1-48dd-8450-9fa649876d31 as bootable. {{(pid=86706) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Copying metadata from image d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d to b0faa622-88c1-48dd-8450-9fa649876d31. {{(pid=86706) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Creating volume glance metadata for volume b0faa622-88c1-48dd-8450-9fa649876d31 backed by image d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d with: {'image_id': 'd3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '94cdeeadfec03725e95f23681e01beaa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86706) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d9a03-5ea2-496a-815d-cc28e7777c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0faa622-88c1-48dd-8450-9fa649876d31', 'volume_size': 1, 'image_id': 'd3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94cdeeadfec03725e95f23681e01beaa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55229d0924454cd8a4d94f9792377183', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d22c8dc1972b350e9fab7edfe7af221369a18378a1aa97b64cec7ea38fd12fa114e638e47dc7715740d21ba8902131766b697d495e0c986a03ffa747a37c76e', 'id': 'd3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d', 'created_at': datetime.datetime(2026, 7, 6, 10, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3f8df0d-085d-47bd-b0ee-3f8e56f5ea3d/file', 'properties': {}}, 'image_service': }' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc08cccc-39ff-47cf-9965-4439c028b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:20 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Volume volume-b0faa622-88c1-48dd-8450-9fa649876d31 (b0faa622-88c1-48dd-8450-9fa649876d31): created successfully Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc08cccc-39ff-47cf-9965-4439c028b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Flow 'volume_create_manager' (d3b2245a-807b-4ae3-8b50-5fc0d5996940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:20 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-d36595e0-c7ab-45d4-9027-89e0e399add6 tempest-VolumeImageDependencyTests-889693622 None] Created volume successfully. Jul 06 12:32:20 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:20 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" returned: 0 in 0.939s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:20 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a is being set with open permissions: ugo+rw Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-69c17a86-ccb1-47df-b36e-43696a8172d2" returned: 0 in 0.789s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:20 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a Jul 06 12:32:20 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-quobyte-69c17a86-ccb1-47df-b36e-43696a8172d2" released by "delete_volume" :: held 1.929s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Created reservations ['957c43bd-f269-4285-9636-94748e0350ab', '5d7a8cba-585f-432b-8ac6-28681385fe5b', '4c0b82b8-3a83-43c3-bb88-a995302058cb', 'ac71827b-19d3-40e7-b848-2d7a454d7e63'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Acquiring lock "cinder-b0faa622-88c1-48dd-8450-9fa649876d31-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:20 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:20 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Lock "cinder-b0faa622-88c1-48dd-8450-9fa649876d31-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Acquiring lock "cinder-quobyte-b0faa622-88c1-48dd-8450-9fa649876d31" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Lock "cinder-quobyte-b0faa622-88c1-48dd-8450-9fa649876d31" acquired by "delete_volume" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da8301-d17f-46ed-b933-bf8eb286cc3e]: (4, 'raw') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:20 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 Jul 06 12:32:20 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:21 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" returned: 0 in 0.867s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:21 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.info Jul 06 12:32:21 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:21 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.914s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:21 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:21 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Deleted volume successfully. Jul 06 12:32:21 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0e4e28f1-a4e9-4f43-bda7-a2e915d07e2d tempest-VolumeDependencyTests-2119557014 None] Lock "cinder-69c17a86-ccb1-47df-b36e-43696a8172d2-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:21 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31" returned: 0 in 1.278s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:22 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 Jul 06 12:32:22 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:22 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.info" returned: 0 in 0.923s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:22 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.info is being set with open permissions: ugo+rw Jul 06 12:32:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:22 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.info Jul 06 12:32:22 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:23 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.info" returned: 0 in 0.924s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.942s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:23 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31" returned: 1 in 1.194s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31' failed. Not Retrying. {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:32:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-961e8b5d-0246-4d79-b996-6e85fbe6895f tempest-CreateVolumesFromSnapshotTest-1602496326 None] Create snapshot completed successfully Jul 06 12:32:23 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31 Jul 06 12:32:23 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:23 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b0faa622-88c1-48dd-8450-9fa649876d31" returned: 0 in 0.852s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Lock "cinder-quobyte-b0faa622-88c1-48dd-8450-9fa649876d31" released by "delete_volume" :: held 3.407s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Created reservations ['d3616c9d-2a3c-4706-a317-826402e0c2e5', '540d33fc-be73-451c-95bf-d6b2b9b9349c', '9e142f03-cf80-4cd3-a655-6170398e4a65', 'ead29761-e60c-43f6-b6b9-f3608e968331'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (758afd64-1b80-4230-b66f-7a71bff2fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f324f5be-7b37-4bef-b621-88187a25f53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f324f5be-7b37-4bef-b621-88187a25f53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276047892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f11a246-c70d-4b90-843d-3f5e00fdebda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:24Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d7ef1e-29fe-4064-9e52-9196b8e04543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d7ef1e-29fe-4064-9e52-9196b8e04543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998c00e8-2e06-484f-9598-8b590bd44ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998c00e8-2e06-484f-9598-8b590bd44ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f11a246-c70d-4b90-843d-3f5e00fdebda', 'volume_name': 'volume-3f11a246-c70d-4b90-843d-3f5e00fdebda', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b50f7e-8beb-4942-b918-2fbc0263c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b50f7e-8beb-4942-b918-2fbc0263c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa1665d-7803-4137-9627-e5b1557dd5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume 3f11a246-c70d-4b90-843d-3f5e00fdebda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f11a246-c70d-4b90-843d-3f5e00fdebda', 'volume_size': 1} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276047892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f11a246-c70d-4b90-843d-3f5e00fdebda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:24Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Creating volume 3f11a246-c70d-4b90-843d-3f5e00fdebda {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:24 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:24 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda 1073741824 Jul 06 12:32:24 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:24 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:24 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (1bb14bf2-557c-41c0-b55a-a3cabb6f3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cde04c-1dec-437f-8a3b-4a1d5be3cde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cde04c-1dec-437f-8a3b-4a1d5be3cde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894622023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f7a782-f03e-43e6-8c20-c0e1989228ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0408699-555d-471f-b6f4-ac9ef2aa1509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0408699-555d-471f-b6f4-ac9ef2aa1509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdf1bd6-d316-4729-8004-e85387381dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdf1bd6-d316-4729-8004-e85387381dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f7a782-f03e-43e6-8c20-c0e1989228ca', 'volume_name': 'volume-32f7a782-f03e-43e6-8c20-c0e1989228ca', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64722296-8dc6-4976-8a93-350362d03dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64722296-8dc6-4976-8a93-350362d03dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76036a7-8573-4557-894d-2c9ffa1c8c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:24 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume 32f7a782-f03e-43e6-8c20-c0e1989228ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f7a782-f03e-43e6-8c20-c0e1989228ca', 'volume_size': 1} Jul 06 12:32:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (146b9c37-45ea-4009-a8ac-2df1b0e9b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa43f8d-03ea-45b8-872d-e3c97d6132b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa43f8d-03ea-45b8-872d-e3c97d6132b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922803902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2761797-965c-4580-82bb-5ab47ebd9049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e2370b-85d0-47f8-a670-90759012a5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e2370b-85d0-47f8-a670-90759012a5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbde69df-f6ab-4c14-9259-db7f3c44bac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbde69df-f6ab-4c14-9259-db7f3c44bac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2761797-965c-4580-82bb-5ab47ebd9049', 'volume_name': 'volume-e2761797-965c-4580-82bb-5ab47ebd9049', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3541228-ac35-4ce7-91d7-8f95b3632c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3541228-ac35-4ce7-91d7-8f95b3632c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5184d362-d380-477c-89bf-5ac346f25ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:25 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume e2761797-965c-4580-82bb-5ab47ebd9049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2761797-965c-4580-82bb-5ab47ebd9049', 'volume_size': 1} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:25 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.335s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Deleted volume successfully. Jul 06 12:32:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-dd458a91-875a-4237-ac5c-f3718e9cd890 tempest-VolumeImageDependencyTests-889693622 None] Lock "cinder-b0faa622-88c1-48dd-8450-9fa649876d31-delete_volume" released by "delete_volume" :: held 5.292s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:26 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (5f3e543c-89f4-4ca1-bc97-31166c915abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cf7bf0-61cb-4972-bf4a-2050841392a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda 1073741824" returned: 0 in 1.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cf7bf0-61cb-4972-bf4a-2050841392a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34817038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cecfd893-9f81-4d0d-8ba0-3fda6c8246c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:26Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a630692-6f32-414f-b9ad-7a6ba0f97965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a630692-6f32-414f-b9ad-7a6ba0f97965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe9dc23-5211-4a41-b793-9c3aab618eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe9dc23-5211-4a41-b793-9c3aab618eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cecfd893-9f81-4d0d-8ba0-3fda6c8246c9', 'volume_name': 'volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233ba8c2-c4a9-4612-90a6-b0e10e813516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233ba8c2-c4a9-4612-90a6-b0e10e813516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9ed72f-1364-426c-84c0-cd9236996a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume cecfd893-9f81-4d0d-8ba0-3fda6c8246c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9', 'volume_size': 1} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:26 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda Jul 06 12:32:26 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (0d542747-6666-44a8-9d04-fe65f3de2122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8e110f-d93d-480c-8a76-f237d03e555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8e110f-d93d-480c-8a76-f237d03e555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682795406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b49f89-c826-4be2-8048-eb91d298794d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:26Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14ea21c-a2ec-4725-a454-2b57536b6ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14ea21c-a2ec-4725-a454-2b57536b6ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7fb0c4-62b6-46a3-931d-222716644fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7fb0c4-62b6-46a3-931d-222716644fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b49f89-c826-4be2-8048-eb91d298794d', 'volume_name': 'volume-67b49f89-c826-4be2-8048-eb91d298794d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0426f50b-ae79-415b-88ac-e1563d1f9998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0426f50b-ae79-415b-88ac-e1563d1f9998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f089fc5-e419-420e-a412-1b2c0ef39ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Volume 67b49f89-c826-4be2-8048-eb91d298794d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b49f89-c826-4be2-8048-eb91d298794d', 'volume_size': 1} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (c966c356-9e98-45a1-9591-db7e54b6db88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c2f92-65d8-4230-bd54-4cb7f4dd737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8c2f92-65d8-4230-bd54-4cb7f4dd737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874219107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954fd45f-1008-4d51-b5a5-9907dc656501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:27Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875a1a50-cf38-4928-9f2b-e85fead31f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875a1a50-cf38-4928-9f2b-e85fead31f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c919aed-f588-4226-a7dd-22b844070475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c919aed-f588-4226-a7dd-22b844070475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954fd45f-1008-4d51-b5a5-9907dc656501', 'volume_name': 'volume-954fd45f-1008-4d51-b5a5-9907dc656501', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7628be5d-6909-474d-9cc7-27e78b1e9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7628be5d-6909-474d-9cc7-27e78b1e9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de513cc-5b63-477d-85d6-4ac5ef89a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:26 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume 954fd45f-1008-4d51-b5a5-9907dc656501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954fd45f-1008-4d51-b5a5-9907dc656501', 'volume_size': 1} Jul 06 12:32:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:27 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:27 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:27 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda" returned: 0 in 0.997s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] <== create_volume: return (2951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.959s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.348s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894622023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f7a782-f03e-43e6-8c20-c0e1989228ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Creating volume 32f7a782-f03e-43e6-8c20-c0e1989228ca {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:27 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:27 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca 1073741824 Jul 06 12:32:27 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa1665d-7803-4137-9627-e5b1557dd5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f11a246-c70d-4b90-843d-3f5e00fdebda', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1d9f3-748e-4690-893e-d159ca624a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:27 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume volume-3f11a246-c70d-4b90-843d-3f5e00fdebda (3f11a246-c70d-4b90-843d-3f5e00fdebda): created successfully Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1d9f3-748e-4690-893e-d159ca624a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (758afd64-1b80-4230-b66f-7a71bff2fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:27 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2a7f79eb-f442-47b9-bd01-67e6dda75d55 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created volume successfully. Jul 06 12:32:27 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.742s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:32:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:32:28 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca 1073741824" returned: 0 in 1.019s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:28 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=142,cinder:UPDATE=182,cinder:INSERT=52,cinder:DELETE=21 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:32:28 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=189,cinder:SELECT=138,cinder:INSERT=50,cinder:DELETE=13 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:32:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:28 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca Jul 06 12:32:28 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:29 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca" returned: 0 in 0.736s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922803902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2761797-965c-4580-82bb-5ab47ebd9049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:25Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Creating volume e2761797-965c-4580-82bb-5ab47ebd9049 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:29 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:29 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 1073741824 Jul 06 12:32:29 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76036a7-8573-4557-894d-2c9ffa1c8c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f7a782-f03e-43e6-8c20-c0e1989228ca', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58988bd5-fb11-47a7-a5b7-26b66ee962a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:29 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume volume-32f7a782-f03e-43e6-8c20-c0e1989228ca (32f7a782-f03e-43e6-8c20-c0e1989228ca): created successfully Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58988bd5-fb11-47a7-a5b7-26b66ee962a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:29 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (1bb14bf2-557c-41c0-b55a-a3cabb6f3a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:29 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8f07d22c-1229-4b8b-a7cc-a2399f1c93eb tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created volume successfully. Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:30 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Flow 'volume_create_manager' (a657c00b-0cd8-4c45-9332-cc1af075ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadfc4a7-aa35-4011-9a83-a336aae5bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 1073741824" returned: 0 in 1.006s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadfc4a7-aa35-4011-9a83-a336aae5bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03d6a68-b2c9-455d-850e-0114be87f37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8136fe6d74fd9b6fd1079f0bf183d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:30Z,use_quota=True,user_id='bf8023f13dd44a90b98561acc24c5547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b16583-2df1-4210-8180-283044b70d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b16583-2df1-4210-8180-283044b70d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96707fe9-f247-41f1-9d89-10f78089ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96707fe9-f247-41f1-9d89-10f78089ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03d6a68-b2c9-455d-850e-0114be87f37d', 'volume_name': 'volume-e03d6a68-b2c9-455d-850e-0114be87f37d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e92b00-3c9b-4fbd-b07a-bd5881b79b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e92b00-3c9b-4fbd-b07a-bd5881b79b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26475367-7b0a-4fc1-9bc2-5cf05d56a115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Volume e03d6a68-b2c9-455d-850e-0114be87f37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03d6a68-b2c9-455d-850e-0114be87f37d', 'volume_size': 1} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:30 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 Jul 06 12:32:30 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:30 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049" returned: 0 in 0.687s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.653s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34817038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cecfd893-9f81-4d0d-8ba0-3fda6c8246c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:26Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Creating volume cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:30 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5184d362-d380-477c-89bf-5ac346f25ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2761797-965c-4580-82bb-5ab47ebd9049', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:30 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 1073741824 Jul 06 12:32:30 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a3e6c0-197b-489f-8232-d8f1319afefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume volume-e2761797-965c-4580-82bb-5ab47ebd9049 (e2761797-965c-4580-82bb-5ab47ebd9049): created successfully Jul 06 12:32:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a3e6c0-197b-489f-8232-d8f1319afefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (146b9c37-45ea-4009-a8ac-2df1b0e9b637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:31 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c149fd5a-82d1-4884-937a-623098c6276a tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created volume successfully. Jul 06 12:32:31 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 1073741824" returned: 0 in 0.945s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:31 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 Jul 06 12:32:31 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:32 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9" returned: 0 in 0.631s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.912s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682795406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b49f89-c826-4be2-8048-eb91d298794d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:26Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Creating volume 67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:32 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:32 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d 1073741824 Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9ed72f-1364-426c-84c0-cd9236996a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:32 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41270c6b-f801-4335-89ba-8ea6d8a7d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 (cecfd893-9f81-4d0d-8ba0-3fda6c8246c9): created successfully Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41270c6b-f801-4335-89ba-8ea6d8a7d33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (5f3e543c-89f4-4ca1-bc97-31166c915abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:32 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9cc969b7-9234-407c-94c0-6bd1e129a126 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created volume successfully. Jul 06 12:32:33 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d 1073741824" returned: 0 in 0.942s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:33 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d Jul 06 12:32:33 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:34 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d" returned: 0 in 0.709s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.328s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874219107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954fd45f-1008-4d51-b5a5-9907dc656501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1087c50f544358bcccad7a7fa4a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:27Z,use_quota=True,user_id='00240750a974482a97a8c766d090ae82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Creating volume 954fd45f-1008-4d51-b5a5-9907dc656501 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:34 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:34 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 1073741824 Jul 06 12:32:34 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f089fc5-e419-420e-a412-1b2c0ef39ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b49f89-c826-4be2-8048-eb91d298794d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67589207-e2b4-4eae-bafb-682e182a6399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:34 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Volume volume-67b49f89-c826-4be2-8048-eb91d298794d (67b49f89-c826-4be2-8048-eb91d298794d): created successfully Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67589207-e2b4-4eae-bafb-682e182a6399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:34 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (0d542747-6666-44a8-9d04-fe65f3de2122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:34 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7f5e7329-3b9b-4a08-a7f7-38b38daa5200 tempest-ProjectReaderTests-324280341 None] Created volume successfully. Jul 06 12:32:35 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 1073741824" returned: 0 in 0.955s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:35 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 Jul 06 12:32:35 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:35 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501" returned: 0 in 0.759s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.820s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03d6a68-b2c9-455d-850e-0114be87f37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8136fe6d74fd9b6fd1079f0bf183d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:30Z,use_quota=True,user_id='bf8023f13dd44a90b98561acc24c5547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Creating volume e03d6a68-b2c9-455d-850e-0114be87f37d {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:35 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de513cc-5b63-477d-85d6-4ac5ef89a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954fd45f-1008-4d51-b5a5-9907dc656501', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92031c84-822a-489c-9494-68b7a3b5570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:36 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d 1073741824 Jul 06 12:32:36 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:36 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Volume volume-954fd45f-1008-4d51-b5a5-9907dc656501 (954fd45f-1008-4d51-b5a5-9907dc656501): created successfully Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92031c84-822a-489c-9494-68b7a3b5570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Flow 'volume_create_manager' (c966c356-9e98-45a1-9591-db7e54b6db88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b2ebd353-7781-4614-a89d-10dded741f39 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created volume successfully. Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-954fd45f-1008-4d51-b5a5-9907dc656501-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-954fd45f-1008-4d51-b5a5-9907dc656501-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-954fd45f-1008-4d51-b5a5-9907dc656501" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-954fd45f-1008-4d51-b5a5-9907dc656501" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[86848133-959a-46ec-84aa-061a69f75e17]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:36 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 Jul 06 12:32:36 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:37 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d 1073741824" returned: 0 in 1.087s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:37 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d Jul 06 12:32:37 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Flow 'volume_create_manager' (be210224-5df6-4849-94c2-3bd84dd981c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d1fa17-fb9e-4642-a16a-4b6de9f5da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d1fa17-fb9e-4642-a16a-4b6de9f5da8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011443344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b499a04d-4a2b-4a78-a868-f0008cd6f615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec465b6b1f147a0982be079299058c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:37Z,use_quota=True,user_id='daeef754b7be4c6583a25af6b64452dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c5f4d1-55fc-485e-802c-b1f25393b28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c5f4d1-55fc-485e-802c-b1f25393b28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9ba9e5-e432-4c6c-bf05-5e3729f7d6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9ba9e5-e432-4c6c-bf05-5e3729f7d6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b499a04d-4a2b-4a78-a868-f0008cd6f615', 'volume_name': 'volume-b499a04d-4a2b-4a78-a868-f0008cd6f615', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5b2d96-efac-4019-bec2-461163aa4b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5b2d96-efac-4019-bec2-461163aa4b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ca40b1-ebc1-4244-8dde-1934cc2cc2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:37 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Volume b499a04d-4a2b-4a78-a868-f0008cd6f615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b499a04d-4a2b-4a78-a868-f0008cd6f615', 'volume_size': 1} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:37 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501" returned: 0 in 0.933s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:37 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501 Jul 06 12:32:37 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:37 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d" returned: 0 in 0.726s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.247s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Creating offline snapshot 52ce1c67-2b8d-4875-9d7b-4ff23178c940 of volume 67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26475367-7b0a-4fc1-9bc2-5cf05d56a115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03d6a68-b2c9-455d-850e-0114be87f37d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be59786-abad-4f27-91d2-3e8a0446cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca70bf8e-43b2-4615-80c5-9a8e4ee3950b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:37 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Volume volume-e03d6a68-b2c9-455d-850e-0114be87f37d (e03d6a68-b2c9-455d-850e-0114be87f37d): created successfully Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be59786-abad-4f27-91d2-3e8a0446cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:37 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Flow 'volume_create_manager' (a657c00b-0cd8-4c45-9332-cc1af075ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cea95fa6-0f17-4f64-a2f0-515e0adf0799 tempest-CinderUnicodeTest-372414892 None] Created volume successfully. Jul 06 12:32:38 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d Jul 06 12:32:38 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:38 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-954fd45f-1008-4d51-b5a5-9907dc656501" returned: 0 in 0.708s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-954fd45f-1008-4d51-b5a5-9907dc656501" released by "delete_volume" :: held 1.684s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created reservations ['8f2db3a2-30d0-4b56-990b-7ebd1528471e', 'f1ce6c1b-0ad5-4589-b150-50b0f2872f4c', '44f9ed57-916c-40cd-8dd1-b5b64f853534', '57f6acc0-70fa-4172-8c78-2e54d9902271'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:38 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:38 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:38 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d" returned: 0 in 0.842s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:38 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 1G Jul 06 12:32:38 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf9ce54-f1ac-43c9-9563-3a2330590e00]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:39 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 Jul 06 12:32:39 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:39 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Flow 'volume_create_manager' (12444787-00f6-4cb8-a6bc-eeba5c18884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66d97d-c8aa-462b-8a98-56f6510ee109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.872s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66d97d-c8aa-462b-8a98-56f6510ee109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-522213753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fec793-652c-4cfb-8e8e-c5ae96933805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8136fe6d74fd9b6fd1079f0bf183d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:39Z,use_quota=True,user_id='bf8023f13dd44a90b98561acc24c5547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d043305-562c-4984-8a96-fb2b8d1d9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d043305-562c-4984-8a96-fb2b8d1d9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fecad3-6c31-427c-a8c9-e9ac21716101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fecad3-6c31-427c-a8c9-e9ac21716101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fec793-652c-4cfb-8e8e-c5ae96933805', 'volume_name': 'volume-30fec793-652c-4cfb-8e8e-c5ae96933805', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6877fac8-96ce-4734-835b-d36e0c1d6b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6877fac8-96ce-4734-835b-d36e0c1d6b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d299017-4ddb-45ff-bc1a-b4fdcc132d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:39 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Volume 30fec793-652c-4cfb-8e8e-c5ae96933805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fec793-652c-4cfb-8e8e-c5ae96933805', 'volume_size': 1} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Deleted volume successfully. Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-00d713f8-f512-4d49-b56f-a9dc111302b5 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-954fd45f-1008-4d51-b5a5-9907dc656501-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:39 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 1G" returned: 0 in 0.974s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b49f89-c826-4be2-8048-eb91d298794d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:39 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b49f89-c826-4be2-8048-eb91d298794d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 Jul 06 12:32:39 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:40 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9" returned: 0 in 0.828s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:40 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9 Jul 06 12:32:40 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:40 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b49f89-c826-4be2-8048-eb91d298794d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940" returned: 0 in 0.725s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:40 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 is being set with open permissions: ugo+rw Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:40 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 Jul 06 12:32:40 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:40 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9" returned: 0 in 0.648s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9" released by "delete_volume" :: held 1.545s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created reservations ['1ea12cfd-f626-49a0-a4f9-c1f95dd7dfa3', 'bebdfae4-ff6c-414b-8186-406a876c763b', 'de6d878a-53fa-407b-9fd9-971de5ccb715', 'e517ea91-d40f-46ef-b0ba-98f2c68b8a05'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:40 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:40 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:41 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940" returned: 0 in 0.673s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:41 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.info Jul 06 12:32:41 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-e2761797-965c-4580-82bb-5ab47ebd9049-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-e2761797-965c-4580-82bb-5ab47ebd9049-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-e2761797-965c-4580-82bb-5ab47ebd9049" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-e2761797-965c-4580-82bb-5ab47ebd9049" acquired by "delete_volume" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fa2e46-361d-4e23-9b88-0a04f436d3a7]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:41 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.737s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Deleted volume successfully. Jul 06 12:32:41 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 Jul 06 12:32:41 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-20e23427-2b4a-409d-a114-f4f064e0279b tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-cecfd893-9f81-4d0d-8ba0-3fda6c8246c9-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:41 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.info" returned: 0 in 0.739s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:41 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.info is being set with open permissions: ugo+rw Jul 06 12:32:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:41 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.info Jul 06 12:32:41 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:42 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049" returned: 0 in 0.805s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:42 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049 Jul 06 12:32:42 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:42 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.info" returned: 0 in 0.677s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.734s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.028s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011443344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b499a04d-4a2b-4a78-a868-f0008cd6f615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec465b6b1f147a0982be079299058c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:37Z,use_quota=True,user_id='daeef754b7be4c6583a25af6b64452dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Creating volume b499a04d-4a2b-4a78-a868-f0008cd6f615 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:42 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:42 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 1073741824 Jul 06 12:32:42 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-247bd68d-8d47-47d0-9bcd-93496518a168 tempest-ProjectReaderTests-324280341 None] Create snapshot completed successfully Jul 06 12:32:43 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e2761797-965c-4580-82bb-5ab47ebd9049" returned: 0 in 0.733s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-e2761797-965c-4580-82bb-5ab47ebd9049" released by "delete_volume" :: held 1.594s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created reservations ['3889d323-cc92-454c-b647-ef5e57b8968d', '1b4a6c91-7534-4335-a1ce-21de46dc2169', '514e5a44-ebc2-497c-b7d8-edab3226b619', '1d99bf3d-007e-41fe-a972-1cab0a03b409'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-52ce1c67-2b8d-4875-9d7b-4ff23178c940-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Lock "cinder-52ce1c67-2b8d-4875-9d7b-4ff23178c940-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-67b49f89-c826-4be2-8048-eb91d298794d" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-67b49f89-c826-4be2-8048-eb91d298794d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-52ce1c67-2b8d-4875-9d7b-4ff23178c940" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:43 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:43 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-52ce1c67-2b8d-4875-9d7b-4ff23178c940" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Deleting offline snapshot 52ce1c67-2b8d-4875-9d7b-4ff23178c940 of volume 67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] snapshot_file for this snap is: volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a32c5d-a210-4ae0-ad23-1e706e012cdf]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:43 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 Jul 06 12:32:43 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:43 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 1073741824" returned: 0 in 0.964s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-32f7a782-f03e-43e6-8c20-c0e1989228ca-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:43 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 Jul 06 12:32:43 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-32f7a782-f03e-43e6-8c20-c0e1989228ca-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-32f7a782-f03e-43e6-8c20-c0e1989228ca" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-32f7a782-f03e-43e6-8c20-c0e1989228ca" acquired by "delete_volume" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e237b01a-231e-4e7b-ab28-6b4111991bff]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:43 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca Jul 06 12:32:43 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:44 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.782s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Deleted volume successfully. Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1ad6b3c7-6c2e-41a0-8f77-e106ba653b6d tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-e2761797-965c-4580-82bb-5ab47ebd9049-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:44 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940" returned: 0 in 0.916s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67b49f89-c826-4be2-8048-eb91d298794d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd504d57-54ad-428e-934a-e26cc49f120e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:44 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d Jul 06 12:32:44 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:44 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615" returned: 0 in 0.826s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.898s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-522213753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fec793-652c-4cfb-8e8e-c5ae96933805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8136fe6d74fd9b6fd1079f0bf183d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:39Z,use_quota=True,user_id='bf8023f13dd44a90b98561acc24c5547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Creating volume 30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:44 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:44 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 1073741824 Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ca40b1-ebc1-4244-8dde-1934cc2cc2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b499a04d-4a2b-4a78-a868-f0008cd6f615', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:44 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c800e2d4-01f5-4005-8f6b-b418ba3cec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:44 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Volume volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 (b499a04d-4a2b-4a78-a868-f0008cd6f615): created successfully Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c800e2d4-01f5-4005-8f6b-b418ba3cec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Flow 'volume_create_manager' (be210224-5df6-4849-94c2-3bd84dd981c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5ff2458e-6ea1-4ab8-8d19-03f059c861a1 tempest-ProjectReaderTests-1424220125 None] Created volume successfully. Jul 06 12:32:44 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca" returned: 0 in 0.902s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:44 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca Jul 06 12:32:44 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Acquiring lock "cinder-b499a04d-4a2b-4a78-a868-f0008cd6f615-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Lock "cinder-b499a04d-4a2b-4a78-a868-f0008cd6f615-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Acquiring lock "cinder-quobyte-b499a04d-4a2b-4a78-a868-f0008cd6f615" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Lock "cinder-quobyte-b499a04d-4a2b-4a78-a868-f0008cd6f615" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:45 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eab187-4508-4b2e-b41e-d980ca5b88bc]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d" returned: 0 in 1.042s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:45 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 Jul 06 12:32:45 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:45 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 Jul 06 12:32:45 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:45 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:45 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 1073741824" returned: 0 in 1.068s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-32f7a782-f03e-43e6-8c20-c0e1989228ca" returned: 0 in 0.847s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-32f7a782-f03e-43e6-8c20-c0e1989228ca" released by "delete_volume" :: held 1.810s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:45 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 Jul 06 12:32:45 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created reservations ['ede8b95b-84a1-451e-8d5f-7b9b904f6af7', 'b9c347f9-ea70-4c7a-853f-ef77ae962382', '32969564-bd0c-4867-bc61-bbd96a441985', '98dd67b4-5979-4a56-9be3-139acbc09b76'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:45 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:45 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-3f11a246-c70d-4b90-843d-3f5e00fdebda-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-3f11a246-c70d-4b90-843d-3f5e00fdebda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-3f11a246-c70d-4b90-843d-3f5e00fdebda" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-3f11a246-c70d-4b90-843d-3f5e00fdebda" acquired by "delete_volume" :: waited 0.031s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b24abe0-05b1-43a4-ad82-0d5bf1b3bb23]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:46 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615" returned: 0 in 0.977s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:46 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615 Jul 06 12:32:46 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:46 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda Jul 06 12:32:46 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:46 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940" returned: 0 in 1.179s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:46 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940 Jul 06 12:32:46 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:46 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Deleted volume successfully. Jul 06 12:32:46 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-872e24c9-8e8c-48f0-bfbb-25154f49ef0e tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-32f7a782-f03e-43e6-8c20-c0e1989228ca-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805" returned: 0 in 1.168s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d299017-4ddb-45ff-bc1a-b4fdcc132d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fec793-652c-4cfb-8e8e-c5ae96933805', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bd3c80-5b74-4738-aed2-bd0632793d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:46 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Volume volume-30fec793-652c-4cfb-8e8e-c5ae96933805 (30fec793-652c-4cfb-8e8e-c5ae96933805): created successfully Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bd3c80-5b74-4738-aed2-bd0632793d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Flow 'volume_create_manager' (12444787-00f6-4cb8-a6bc-eeba5c18884f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a99cef60-3957-4be4-802e-0c93b366ca52 tempest-CinderUnicodeTest-372414892 None] Created volume successfully. Jul 06 12:32:47 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda" returned: 0 in 1.105s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:47 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-b499a04d-4a2b-4a78-a868-f0008cd6f615" returned: 0 in 0.989s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:47 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda Jul 06 12:32:47 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Lock "cinder-quobyte-b499a04d-4a2b-4a78-a868-f0008cd6f615" released by "delete_volume" :: held 2.027s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Created reservations ['d646cf64-06a2-4cf0-93cc-aa72322d2d83', '052e71bc-8fcb-4551-854c-3347157ed5aa', '69c81d3c-41bd-4d72-a9bc-a5375f4bbc31', '0d25b01e-e470-420e-8f25-c7fd884fc262'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:47 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d.52ce1c67-2b8d-4875-9d7b-4ff23178c940" returned: 0 in 0.951s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-52ce1c67-2b8d-4875-9d7b-4ff23178c940" released by "_delete_snapshot" :: held 4.228s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-67b49f89-c826-4be2-8048-eb91d298794d" released by "delete_snapshot" :: held 4.260s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:47 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:47 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Created reservations ['6dfec814-80e0-487a-a613-ea1f448aeec3', '91bb22b8-efb4-41ad-a8c1-c21a5ac09beb', '7c7432ca-54b5-4c55-baaf-8ac64e65d97b', 'a665eaef-be2a-49ef-bf69-290a7b248c76'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:47 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Delete snapshot completed successfully. Jul 06 12:32:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c7c68752-6247-4ebb-be0e-f3ac5b1892f3 tempest-ProjectReaderTests-324280341 None] Lock "cinder-52ce1c67-2b8d-4875-9d7b-4ff23178c940-delete_snapshot" released by "delete_snapshot" :: held 4.449s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:48 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f11a246-c70d-4b90-843d-3f5e00fdebda" returned: 0 in 0.762s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-3f11a246-c70d-4b90-843d-3f5e00fdebda" released by "delete_volume" :: held 1.914s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created reservations ['35dd6cfc-ab94-40d2-bbe5-cf41f71d5367', '49f76174-6b10-4ad1-b915-fd980521da21', '42c8e720-7822-49e3-a825-8b1d6cf7bbcc', '889b55b8-35d2-4249-bf1e-4ef98545f3c2'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:48 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.677s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:48 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Deleted volume successfully. Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-1a70e86a-7633-4b5b-83ae-35b8678e4aae tempest-ProjectReaderTests-1424220125 None] Lock "cinder-b499a04d-4a2b-4a78-a868-f0008cd6f615-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:48 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:48 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Creating offline snapshot 4009dd84-c3a8-4714-a4f7-210cc8fa8c85 of volume 30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[adae6179-d262-42f2-9f65-76ed4051cac0]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Deleting offline snapshot 577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a of volume 5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] snapshot_file for this snap is: volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b1e597-8fa6-4281-ad92-20e9f4a0d6b1]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:48 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 Jul 06 12:32:48 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:48 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a Jul 06 12:32:48 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-67b49f89-c826-4be2-8048-eb91d298794d-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Lock "cinder-67b49f89-c826-4be2-8048-eb91d298794d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-67b49f89-c826-4be2-8048-eb91d298794d" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-67b49f89-c826-4be2-8048-eb91d298794d" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e85269-4391-4113-aecd-152a1bf75e5e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:49 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d Jul 06 12:32:49 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Flow 'volume_create_manager' (004cd59f-494f-4732-8333-c88bfd6d083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95cb794-9cad-48c6-957c-320b2d3fa602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95cb794-9cad-48c6-957c-320b2d3fa602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30027915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eededc92-dcb9-44c1-a89d-c1edb6be7f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec465b6b1f147a0982be079299058c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:49Z,use_quota=True,user_id='daeef754b7be4c6583a25af6b64452dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06f252d-7eaa-413e-88b7-d4d435e4b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06f252d-7eaa-413e-88b7-d4d435e4b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb9fc81-222d-4381-9605-90b2ec40928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb9fc81-222d-4381-9605-90b2ec40928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eededc92-dcb9-44c1-a89d-c1edb6be7f39', 'volume_name': 'volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e557d4-aee5-41ed-8954-76e65d383023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e557d4-aee5-41ed-8954-76e65d383023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6ae136-aa46-44fd-8248-78e703e47b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Volume eededc92-dcb9-44c1-a89d-c1edb6be7f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39', 'volume_size': 1} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:49 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805" returned: 0 in 1.171s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:49 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 1G Jul 06 12:32:49 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:49 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.369s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Deleted volume successfully. Jul 06 12:32:49 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" returned: 0 in 1.181s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6a66f7d7-fe2b-429b-9cd2-7346c37cf092 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-3f11a246-c70d-4b90-843d-3f5e00fdebda-delete_volume" released by "delete_volume" :: held 3.656s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fe0252-2da0-4e5a-af4e-f4205115c104]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:49 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d" returned: 0 in 0.935s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:49 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 Jul 06 12:32:49 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:49 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d Jul 06 12:32:49 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:50 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-67b49f89-c826-4be2-8048-eb91d298794d" returned: 0 in 0.732s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-67b49f89-c826-4be2-8048-eb91d298794d" released by "delete_volume" :: held 1.744s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:50 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" returned: 0 in 0.863s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:50 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 1G" returned: 0 in 1.025s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fec793-652c-4cfb-8e8e-c5ae96933805 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:50 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a Jul 06 12:32:50 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:50 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fec793-652c-4cfb-8e8e-c5ae96933805 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 Jul 06 12:32:50 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Created reservations ['30d59878-87e9-41b4-acf4-5cf55f1614d2', '4c613d76-cb11-4870-ad92-3e7cb0f1674c', '26934fb6-a42f-44bd-9841-018b7f097eeb', '08d87f7a-4dee-4a5d-b562-6f1e80cf5b64'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:50 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:50 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:51 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fec793-652c-4cfb-8e8e-c5ae96933805 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85" returned: 0 in 0.866s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:51 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 is being set with open permissions: ugo+rw Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:51 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" returned: 0 in 0.923s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:51 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 Jul 06 12:32:51 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:51 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a Jul 06 12:32:51 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:51 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.947s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (0b5f50aa-450d-4942-ab26-4da581034376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1832ac-94c8-4bf2-826c-b1afb4c54d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Deleted volume successfully. Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1832ac-94c8-4bf2-826c-b1afb4c54d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944809006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06a8038-6694-4aba-8f07-c5078ba7cf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:52Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b7cedb-b354-4125-a66d-062619271f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b7cedb-b354-4125-a66d-062619271f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eda2030-ebe5-435a-a1d9-eeeb0d2c9324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eda2030-ebe5-435a-a1d9-eeeb0d2c9324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06a8038-6694-4aba-8f07-c5078ba7cf83', 'volume_name': 'volume-d06a8038-6694-4aba-8f07-c5078ba7cf83', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d18468-e78d-431c-8bfe-845e5228cacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d18468-e78d-431c-8bfe-845e5228cacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea3cfc9-338d-45bc-ab37-9f1224549bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Volume d06a8038-6694-4aba-8f07-c5078ba7cf83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06a8038-6694-4aba-8f07-c5078ba7cf83', 'volume_size': 1} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a14069f3-429b-459b-a6dd-baa86c291ace tempest-ProjectReaderTests-324280341 None] Lock "cinder-67b49f89-c826-4be2-8048-eb91d298794d-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:52 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653.577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" returned: 0 in 0.710s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a" released by "_delete_snapshot" :: held 3.830s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:52 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85" returned: 0 in 0.787s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" released by "delete_snapshot" :: held 3.863s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:52 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.info Jul 06 12:32:52 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created reservations ['344d3fa2-48d8-4bbb-a12e-8feb334fce70', '0ca19c02-dd4d-4cef-8213-dcbf98dd0b4b', '86671dd3-a8f8-401a-8ff6-bd7eb3fd8df0', 'a657f1b1-a3f7-4507-9d72-f3228e66f480'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:52 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Delete snapshot completed successfully. Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6fce3501-3e1c-46b8-9fd1-add042802c46 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-577d1c90-3d2d-4ac1-8c10-1ecb8cdf801a-delete_snapshot" released by "delete_snapshot" :: held 4.065s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "cinder-quobyte-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[06295e34-d948-4dd0-8776-da49b9f33caa]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:52 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 Jul 06 12:32:52 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:52 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.info" returned: 0 in 0.690s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:53 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.info is being set with open permissions: ugo+rw Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:53 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.info Jul 06 12:32:53 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:53 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" returned: 0 in 0.837s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:53 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.info" returned: 0 in 0.677s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:53 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653 Jul 06 12:32:53 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.337s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.217s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30027915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eededc92-dcb9-44c1-a89d-c1edb6be7f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec465b6b1f147a0982be079299058c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:49Z,use_quota=True,user_id='daeef754b7be4c6583a25af6b64452dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Creating volume eededc92-dcb9-44c1-a89d-c1edb6be7f39 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:53 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:53 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 1073741824 Jul 06 12:32:53 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-13cbe2e9-5df7-4243-b8a5-eb143a796aba tempest-CinderUnicodeTest-372414892 None] Create snapshot completed successfully Jul 06 12:32:54 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" returned: 0 in 0.665s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-quobyte-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653" released by "delete_volume" :: held 1.562s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Created reservations ['a3d3b74c-3e95-41fc-81ff-544d99deb18e', '7ba92e98-c49d-4a7b-a8dc-adf3c316276c', '5d3d8ca4-7e0a-4d2b-a247-9e711966ab8d', '69522480-987c-4b06-b1f6-e28f2b22b2ab'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:54 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:54 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:54 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 1073741824" returned: 0 in 0.973s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "cinder-4009dd84-c3a8-4714-a4f7-210cc8fa8c85-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:54 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-4009dd84-c3a8-4714-a4f7-210cc8fa8c85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "cinder-quobyte-30fec793-652c-4cfb-8e8e-c5ae96933805" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:54 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-30fec793-652c-4cfb-8e8e-c5ae96933805" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "cinder-quobyte-4009dd84-c3a8-4714-a4f7-210cc8fa8c85" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-4009dd84-c3a8-4714-a4f7-210cc8fa8c85" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Deleting offline snapshot 4009dd84-c3a8-4714-a4f7-210cc8fa8c85 of volume 30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] snapshot_file for this snap is: volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc1708-c22a-4685-b5b5-2c613767fa83]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:55 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 Jul 06 12:32:55 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:55 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.800s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:55 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Deleted volume successfully. Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ff5575ac-1fd7-4e52-9ed9-f4fe84313d90 tempest-CreateVolumesFromSnapshotTest-1602496326 None] Lock "cinder-5fc40ef3-04bc-49e8-b679-3f1b8d9c6653-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:55 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39" returned: 0 in 0.896s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.823s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944809006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06a8038-6694-4aba-8f07-c5078ba7cf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:52Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Creating volume d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:55 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6ae136-aa46-44fd-8248-78e703e47b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:55 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 1073741824 Jul 06 12:32:55 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207c88fe-b60d-4040-bbfb-05e21ed29480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Volume volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 (eededc92-dcb9-44c1-a89d-c1edb6be7f39): created successfully Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207c88fe-b60d-4040-bbfb-05e21ed29480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Flow 'volume_create_manager' (004cd59f-494f-4732-8333-c88bfd6d083b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:55 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3dc6d8f9-4403-4e51-a341-719d2c2e8c74 tempest-ProjectReaderTests-1424220125 None] Created volume successfully. Jul 06 12:32:55 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85" returned: 0 in 0.928s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30fec793-652c-4cfb-8e8e-c5ae96933805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b775c-14b7-4c63-b2d7-0cdabb2f7435]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:56 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 Jul 06 12:32:56 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:56 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 1073741824" returned: 0 in 1.118s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:56 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805" returned: 0 in 0.935s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:56 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 Jul 06 12:32:56 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Acquiring lock "cinder-eededc92-dcb9-44c1-a89d-c1edb6be7f39-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:56 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 Jul 06 12:32:56 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Lock "cinder-eededc92-dcb9-44c1-a89d-c1edb6be7f39-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Acquiring lock "cinder-quobyte-eededc92-dcb9-44c1-a89d-c1edb6be7f39" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Lock "cinder-quobyte-eededc92-dcb9-44c1-a89d-c1edb6be7f39" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4febc111-95b6-4239-8314-2e4d99511594]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:57 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 Jul 06 12:32:57 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:57 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83" returned: 0 in 0.886s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea3cfc9-338d-45bc-ab37-9f1224549bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06a8038-6694-4aba-8f07-c5078ba7cf83', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3472e981-6b8c-48f2-96c0-ac5f062b7f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Volume volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 (d06a8038-6694-4aba-8f07-c5078ba7cf83): created successfully Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3472e981-6b8c-48f2-96c0-ac5f062b7f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (0b5f50aa-450d-4942-ab26-4da581034376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:57 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85" returned: 0 in 0.989s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-73b0381c-2502-46f9-a2e7-7958c5d3a242 tempest-ProjectReaderTests-324280341 None] Created volume successfully. Jul 06 12:32:57 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85 Jul 06 12:32:57 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:57 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39" returned: 0 in 0.910s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:57 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39 Jul 06 12:32:57 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Creating offline snapshot 9bdbe1c5-6ee0-4007-b513-054c88af57ae of volume d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[097f06ce-e1d1-48e0-bc6c-a117c1c9506e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:58 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805.4009dd84-c3a8-4714-a4f7-210cc8fa8c85" returned: 0 in 0.778s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-4009dd84-c3a8-4714-a4f7-210cc8fa8c85" released by "_delete_snapshot" :: held 3.781s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-30fec793-652c-4cfb-8e8e-c5ae96933805" released by "delete_snapshot" :: held 3.813s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:58 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 Jul 06 12:32:58 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Created reservations ['569a7241-2342-4d4b-8f18-e0bbd721ec26', '1a81964a-de1f-41d1-b22f-de6cb0167a8d', '3f04eb7b-0e72-4f4f-84ad-9cec6373f443', '4a828503-838c-453d-bb99-eb1f129b3839'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:58 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-eededc92-dcb9-44c1-a89d-c1edb6be7f39" returned: 0 in 0.912s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Lock "cinder-quobyte-eededc92-dcb9-44c1-a89d-c1edb6be7f39" released by "delete_volume" :: held 1.889s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Delete snapshot completed successfully. Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-952125f2-65f3-4ce0-a41d-879857914286 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-4009dd84-c3a8-4714-a4f7-210cc8fa8c85-delete_snapshot" released by "delete_snapshot" :: held 4.150s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:58 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Created reservations ['1851706b-4445-483c-ad02-a4f9a98e5586', '9c1dbe2d-4686-4d71-9c7b-25b8cbb8b77c', '2e68f312-a30e-458a-abe5-573f0db89614', '376a17fb-8c89-4b23-bf1b-eb9822ae6d29'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Acquiring lock "cinder-30fec793-652c-4cfb-8e8e-c5ae96933805-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:59 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:32:59 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Lock "cinder-30fec793-652c-4cfb-8e8e-c5ae96933805-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Acquiring lock "cinder-quobyte-30fec793-652c-4cfb-8e8e-c5ae96933805" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-30fec793-652c-4cfb-8e8e-c5ae96933805" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[812b2e42-917e-420d-9caa-0f609405be12]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:59 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 Jul 06 12:32:59 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:59 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83" returned: 0 in 1.369s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:59 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae 1G Jul 06 12:32:59 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:59 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.933s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:59 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Deleted volume successfully. Jul 06 12:33:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5882aae1-1bd9-4c98-9d4f-59c83e29ab85 tempest-ProjectReaderTests-1424220125 None] Lock "cinder-eededc92-dcb9-44c1-a89d-c1edb6be7f39-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:00 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805" returned: 0 in 1.116s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:00 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805 Jul 06 12:33:00 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:00 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae 1G" returned: 0 in 1.109s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:01 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae Jul 06 12:33:01 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:01 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-30fec793-652c-4cfb-8e8e-c5ae96933805" returned: 0 in 1.044s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-30fec793-652c-4cfb-8e8e-c5ae96933805" released by "delete_volume" :: held 2.278s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Created reservations ['c743f8d4-85e2-46b7-a835-9d58ec073e40', '18634404-b260-4c39-9914-a21cc3b6cbd2', '0aa8eb64-b877-4212-abdf-e17db8c156be', 'b6003db0-e69a-4c21-a569-0509f5e650ee'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:01 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:33:01 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:02 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae" returned: 0 in 1.090s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:02 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae is being set with open permissions: ugo+rw Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:02 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae Jul 06 12:33:02 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "cinder-e03d6a68-b2c9-455d-850e-0114be87f37d-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-e03d6a68-b2c9-455d-850e-0114be87f37d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "cinder-quobyte-e03d6a68-b2c9-455d-850e-0114be87f37d" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:02 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-e03d6a68-b2c9-455d-850e-0114be87f37d" acquired by "delete_volume" :: waited 0.054s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.101s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Deleted volume successfully. Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf426094-dab4-44c0-bc0e-4f5a65dd97f9]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:02 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-68335592-1956-4d37-a6ba-21926eb8011e tempest-CinderUnicodeTest-372414892 None] Lock "cinder-30fec793-652c-4cfb-8e8e-c5ae96933805-delete_volume" released by "delete_volume" :: held 3.762s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:02 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d Jul 06 12:33:02 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:03 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae" returned: 0 in 1.105s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:03 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.info Jul 06 12:33:03 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:03 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d" returned: 0 in 1.137s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:04 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d Jul 06 12:33:04 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:04 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.info" returned: 0 in 1.028s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:04 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.info is being set with open permissions: ugo+rw Jul 06 12:33:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:04 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.info Jul 06 12:33:04 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:04 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e03d6a68-b2c9-455d-850e-0114be87f37d" returned: 0 in 0.868s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-quobyte-e03d6a68-b2c9-455d-850e-0114be87f37d" released by "delete_volume" :: held 2.096s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:04 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Created reservations ['b78c2f97-4c2e-4903-8b4c-9bc732d5bea9', '28981b19-78ec-49d4-8e3c-703372b9d785', 'efba5327-03d8-4673-b882-3ceab773e558', 'd5fa4e58-c221-48f0-8d00-140285f6a5cb'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:05 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:33:05 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:05 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.info" returned: 0 in 0.952s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.783s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c60016a2-ae26-4a00-ae4a-cde6c96487db tempest-ProjectReaderTests-324280341 None] Create snapshot completed successfully Jul 06 12:33:05 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.802s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Deleted volume successfully. Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-9bdbe1c5-6ee0-4007-b513-054c88af57ae-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-c6ca16ce-59de-42c6-bb54-a055dc4233e7 tempest-CinderUnicodeTest-372414892 None] Lock "cinder-e03d6a68-b2c9-455d-850e-0114be87f37d-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Lock "cinder-9bdbe1c5-6ee0-4007-b513-054c88af57ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-d06a8038-6694-4aba-8f07-c5078ba7cf83" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-d06a8038-6694-4aba-8f07-c5078ba7cf83" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-9bdbe1c5-6ee0-4007-b513-054c88af57ae" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-9bdbe1c5-6ee0-4007-b513-054c88af57ae" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Deleting offline snapshot 9bdbe1c5-6ee0-4007-b513-054c88af57ae of volume d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:33:06 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] snapshot_file for this snap is: volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:33:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9894b3-da41-48e6-b7c9-0c73e4670cbb]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:06 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae Jul 06 12:33:06 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:07 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae" returned: 0 in 1.051s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d06a8038-6694-4aba-8f07-c5078ba7cf83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:33:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16501e7-f114-47fc-a07e-357bb7f4044c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:07 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 Jul 06 12:33:07 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:08 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83" returned: 0 in 1.064s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:08 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae Jul 06 12:33:08 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:09 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae" returned: 0 in 1.051s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:09 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae Jul 06 12:33:09 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:10 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83.9bdbe1c5-6ee0-4007-b513-054c88af57ae" returned: 0 in 1.056s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-9bdbe1c5-6ee0-4007-b513-054c88af57ae" released by "_delete_snapshot" :: held 4.379s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-d06a8038-6694-4aba-8f07-c5078ba7cf83" released by "delete_snapshot" :: held 4.408s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:10 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Created reservations ['0370f4de-3d0a-4c2f-8345-48ad9ce79e96', 'a1376d0d-b1e7-4a60-9eb5-18ca74c2a493', '260ce4de-4812-4f61-a507-e54177ed624f', '0b37581d-b201-4ebd-ae14-0d654ce97859'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:10 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Delete snapshot completed successfully. Jul 06 12:33:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98b734bb-1ce0-4594-a5c4-a7ab3a2b4285 tempest-ProjectReaderTests-324280341 None] Lock "cinder-9bdbe1c5-6ee0-4007-b513-054c88af57ae-delete_snapshot" released by "delete_snapshot" :: held 4.637s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-02ec3024-9550-458f-a3cc-dde191074327 tempest-ProjectAdminTests-1952507097 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86706) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:33:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-d06a8038-6694-4aba-8f07-c5078ba7cf83-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Lock "cinder-d06a8038-6694-4aba-8f07-c5078ba7cf83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-d06a8038-6694-4aba-8f07-c5078ba7cf83" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-d06a8038-6694-4aba-8f07-c5078ba7cf83" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:11 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5e34aa-ad25-480c-9357-92670afa2593]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:11 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 Jul 06 12:33:11 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:12 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83" returned: 0 in 1.074s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:12 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83 Jul 06 12:33:12 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:13 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d06a8038-6694-4aba-8f07-c5078ba7cf83" returned: 0 in 0.839s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-d06a8038-6694-4aba-8f07-c5078ba7cf83" released by "delete_volume" :: held 2.011s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Created reservations ['836a4c13-3f1f-4c5d-a73b-a7c1297f278d', '1487579a-d853-4419-b267-29922c63ea89', '22fa8759-26ec-4c4a-9691-b64fd65ab463', 'bdad92b7-08dd-474b-875d-ba568c4a170f'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:13 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:33:13 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (558e9b69-c705-4faf-a312-117d9287aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8a97a0-1a17-4472-aa49-8e8782e89c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8a97a0-1a17-4472-aa49-8e8782e89c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555991361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b048b6f-67aa-4dbd-b16f-91be47e7b259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:15Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3a51c2-25b2-4180-8e2d-691f93003d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3a51c2-25b2-4180-8e2d-691f93003d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2efd79-e735-46ae-8d42-c895f59477a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2efd79-e735-46ae-8d42-c895f59477a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b048b6f-67aa-4dbd-b16f-91be47e7b259', 'volume_name': 'volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9514c-ec5f-4359-a7fb-c370a498a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9514c-ec5f-4359-a7fb-c370a498a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146b3a67-9ec4-43c5-b23c-34ce5087ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:14 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Volume 3b048b6f-67aa-4dbd-b16f-91be47e7b259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259', 'volume_size': 1} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555991361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b048b6f-67aa-4dbd-b16f-91be47e7b259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:15Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Creating volume 3b048b6f-67aa-4dbd-b16f-91be47e7b259 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:14 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:14 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 1073741824 Jul 06 12:33:14 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:14 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 1.193s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:14 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:14 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Deleted volume successfully. Jul 06 12:33:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-0990c602-a07e-4965-9bba-ad7e8db7cf3d tempest-ProjectReaderTests-324280341 None] Lock "cinder-d06a8038-6694-4aba-8f07-c5078ba7cf83-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:16 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 1073741824" returned: 0 in 1.196s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:16 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 Jul 06 12:33:16 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:17 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259" returned: 0 in 0.932s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146b3a67-9ec4-43c5-b23c-34ce5087ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57fb428-318f-4a51-811e-d8536bf7ae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:17 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Volume volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 (3b048b6f-67aa-4dbd-b16f-91be47e7b259): created successfully Jul 06 12:33:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57fb428-318f-4a51-811e-d8536bf7ae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (558e9b69-c705-4faf-a312-117d9287aa23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:17 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f5c62dfe-f7d5-4fc7-8dc8-0be4b1a34bb7 tempest-ProjectReaderTests-324280341 None] Created volume successfully. Jul 06 12:33:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Creating offline snapshot 0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 of volume 3b048b6f-67aa-4dbd-b16f-91be47e7b259 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:33:18 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4e630f-9e14-4b7e-8e1c-5f2f6ddbd112]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:18 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 Jul 06 12:33:18 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:19 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259" returned: 0 in 1.062s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:19 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 1G Jul 06 12:33:19 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:20 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 1G" returned: 0 in 1.045s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:20 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 Jul 06 12:33:20 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:21 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6" returned: 0 in 0.808s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:21 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 is being set with open permissions: ugo+rw Jul 06 12:33:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:21 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6 Jul 06 12:33:21 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:21 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6" returned: 0 in 0.723s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:21 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.info Jul 06 12:33:21 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:22 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.info" returned: 0 in 0.668s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:22 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.info is being set with open permissions: ugo+rw Jul 06 12:33:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:22 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.info Jul 06 12:33:22 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:23 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3b048b6f-67aa-4dbd-b16f-91be47e7b259.info" returned: 0 in 0.633s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.053s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-94011dc4-6b67-4e20-b064-23499fdc7787 tempest-ProjectReaderTests-324280341 None] Create snapshot completed successfully Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92e2ce3e-bec2-46a8-a221-2c61220746a4 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92e2ce3e-bec2-46a8-a221-2c61220746a4 tempest-ProjectReaderTests-324280341 None] Lock "cinder-0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:23 devstack cinder-volume[86706]: INFO cinder.message.api [None req-92e2ce3e-bec2-46a8-a221-2c61220746a4 tempest-ProjectReaderTests-324280341 None] Creating message record for request_id = req-92e2ce3e-bec2-46a8-a221-2c61220746a4 Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92e2ce3e-bec2-46a8-a221-2c61220746a4 tempest-ProjectReaderTests-324280341 None] Lock "cinder-0821aa29-b5a1-4b56-87cc-1bd3fa0f4ab6-delete_snapshot" released by "delete_snapshot" :: held 0.066s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server [None req-92e2ce3e-bec2-46a8-a221-2c61220746a4 tempest-ProjectReaderTests-324280341 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:33:23 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (02d28545-a7fa-4662-8a60-2b2b032cc47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d9d746-7c00-4242-b5c1-9ec208c864fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d9d746-7c00-4242-b5c1-9ec208c864fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890523494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a56b0-b2ee-4f6d-afb2-b3bc4b181fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:24Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d920951-800c-4b6f-ac58-bcb0740368e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d920951-800c-4b6f-ac58-bcb0740368e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16e772a-a3c3-42cb-a8b0-6d35f7e387e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16e772a-a3c3-42cb-a8b0-6d35f7e387e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900a56b0-b2ee-4f6d-afb2-b3bc4b181fae', 'volume_name': 'volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d0039-79b0-43f2-8ad1-c6b02b2982f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d0039-79b0-43f2-8ad1-c6b02b2982f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab500f0-a212-4111-97d1-3c8357ba90d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:23 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Volume 900a56b0-b2ee-4f6d-afb2-b3bc4b181fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae', 'volume_size': 1} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890523494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a56b0-b2ee-4f6d-afb2-b3bc4b181fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:24Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Creating volume 900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:23 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:33:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:23 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae 1073741824 Jul 06 12:33:23 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:24 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae 1073741824" returned: 0 in 1.129s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:25 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae Jul 06 12:33:25 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:25 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" returned: 0 in 0.730s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab500f0-a212-4111-97d1-3c8357ba90d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077aa7d1-8ee4-4490-add4-f7984dcd75f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:25 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Volume volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae (900a56b0-b2ee-4f6d-afb2-b3bc4b181fae): created successfully Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077aa7d1-8ee4-4490-add4-f7984dcd75f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:25 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (02d28545-a7fa-4662-8a60-2b2b032cc47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:25 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f59a801e-b113-4178-be22-b1cb3e80654c tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:27 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:33:27 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot 5775f50a-8a39-434c-856a-8b3098a4c7c7 of volume 900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc74f2f-6bcf-4eeb-9945-3998ae0121e1]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:27 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae Jul 06 12:33:27 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:27 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.793s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:33:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:33:28 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" returned: 0 in 0.818s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:28 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 1G Jul 06 12:33:28 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:29 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 1G" returned: 0 in 0.875s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:29 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 Jul 06 12:33:29 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:29 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7" returned: 0 in 0.740s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:29 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 is being set with open permissions: ugo+rw Jul 06 12:33:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:29 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 Jul 06 12:33:29 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:30 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7" returned: 0 in 0.685s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:30 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=140,cinder:DELETE=14,cinder:SELECT=127,cinder:INSERT=40 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:33:30 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=175,cinder:SELECT=95,cinder:INSERT=40,cinder:DELETE=14 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:33:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:30 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.info Jul 06 12:33:30 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:31 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.info" returned: 0 in 0.652s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:31 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.info is being set with open permissions: ugo+rw Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:31 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.info Jul 06 12:33:31 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Flow 'volume_create_manager' (09968b2b-dc27-4017-b475-ad642547efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660c68f4-0bfd-42e5-9973-88f02d0d6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660c68f4-0bfd-42e5-9973-88f02d0d6192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1263714820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76cc2ef-b16a-446b-8bb2-a92af9d4a546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77940603076147568e709a86dbd4ddf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:31Z,use_quota=True,user_id='95b1065400174dcf93cfd6fb8380a95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974e4db1-79cd-4344-bd6e-e71fe13ca508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974e4db1-79cd-4344-bd6e-e71fe13ca508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5534fb4e-b989-4404-b019-e5a779163f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5534fb4e-b989-4404-b019-e5a779163f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76cc2ef-b16a-446b-8bb2-a92af9d4a546', 'volume_name': 'volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d74cb0-0ac2-4122-a6c3-ae64659485f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d74cb0-0ac2-4122-a6c3-ae64659485f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183bcf2b-43d2-4546-af39-affb234e96e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:31 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Volume d76cc2ef-b16a-446b-8bb2-a92af9d4a546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546', 'volume_size': 1} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:31 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.info" returned: 0 in 0.617s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.505s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1263714820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76cc2ef-b16a-446b-8bb2-a92af9d4a546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77940603076147568e709a86dbd4ddf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:31Z,use_quota=True,user_id='95b1065400174dcf93cfd6fb8380a95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Creating volume d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:31 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:33:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:31 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 1073741824 Jul 06 12:33:31 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:31 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-87af611d-666b-4685-a3c9-46826c6ecf32 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-5775f50a-8a39-434c-856a-8b3098a4c7c7-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Lock "cinder-5775f50a-8a39-434c-856a-8b3098a4c7c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-5775f50a-8a39-434c-856a-8b3098a4c7c7" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-5775f50a-8a39-434c-856a-8b3098a4c7c7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot 5775f50a-8a39-434c-856a-8b3098a4c7c7 of volume 900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ca9ab-8e9b-45f8-9e64-e0c55c76a95b]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:32 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 1073741824" returned: 0 in 0.861s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:32 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 Jul 06 12:33:32 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:32 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 Jul 06 12:33:32 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:33 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" returned: 0 in 0.663s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183bcf2b-43d2-4546-af39-affb234e96e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6f5134-53df-41f4-9b47-9be3437cadc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:33 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Volume volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 (d76cc2ef-b16a-446b-8bb2-a92af9d4a546): created successfully Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6f5134-53df-41f4-9b47-9be3437cadc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Flow 'volume_create_manager' (09968b2b-dc27-4017-b475-ad642547efe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:33 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-88208f27-4af4-4b88-8910-96cc9db97bcc tempest-SnapshotDependencyTests-1600160658 None] Created volume successfully. Jul 06 12:33:33 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7" returned: 0 in 0.843s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca41bf8-db49-49b8-a445-45e780faac89]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:33 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae Jul 06 12:33:33 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:34 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" returned: 0 in 0.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:34 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 Jul 06 12:33:34 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Creating offline snapshot 71264c1c-3e7a-49d1-945c-55a0cd710cdf of volume d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:33:34 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f267e7-70ec-4590-bfc1-ba2c486b3a36]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:34 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 Jul 06 12:33:34 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:35 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7" returned: 0 in 0.791s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:35 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7 Jul 06 12:33:35 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:35 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" returned: 0 in 0.812s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:35 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf 1G Jul 06 12:33:35 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:35 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae.5775f50a-8a39-434c-856a-8b3098a4c7c7" returned: 0 in 0.699s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-5775f50a-8a39-434c-856a-8b3098a4c7c7" released by "_delete_snapshot" :: held 3.218s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" released by "delete_snapshot" :: held 3.245s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:35 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Created reservations ['5d0e4928-67e2-4487-af3b-2ab6d68af08f', '4fff069e-b974-4a9a-95bf-711f2e632318', 'c21bd0a0-9638-41dd-b65d-ba235b63edd7', '5116c239-6ea1-4b7b-a028-2c2c39b198f1'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:36 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:33:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2c4bf942-354f-4610-a9d5-07cb43a652ed tempest-ProjectMemberTests-1317769893 None] Lock "cinder-5775f50a-8a39-434c-856a-8b3098a4c7c7-delete_snapshot" released by "delete_snapshot" :: held 3.401s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:36 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf 1G" returned: 0 in 0.784s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:36 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf Jul 06 12:33:36 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:36 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b04f85-b266-4e4b-865a-94060a76a9fc]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:37 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae Jul 06 12:33:37 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:37 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf" returned: 0 in 0.737s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:37 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf is being set with open permissions: ugo+rw Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:37 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf Jul 06 12:33:37 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:37 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" returned: 0 in 0.770s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:37 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf" returned: 0 in 0.629s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:37 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae Jul 06 12:33:37 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:37 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.info Jul 06 12:33:37 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:38 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" returned: 0 in 0.656s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae" released by "delete_volume" :: held 1.495s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:38 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.info" returned: 0 in 0.658s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:38 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.info is being set with open permissions: ugo+rw Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:38 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.info Jul 06 12:33:38 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Created reservations ['05c7410b-7d1f-4505-a6df-a2806f8e19fc', '38ca1677-d65d-4116-b134-6e08e7fc5de4', '74dab0e6-2ce3-4545-9b49-17172be01e40', '136aaeda-ad31-423f-acc4-367018301ea8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:38 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:33:38 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:39 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.info" returned: 0 in 0.679s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6d5c1a90-6c59-48b4-bf45-95f879912974 tempest-SnapshotDependencyTests-1600160658 None] Create snapshot completed successfully Jul 06 12:33:39 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.663s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:39 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-f90f2bbc-4c0c-49ed-b8e5-2536a127aa83 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-900a56b0-b2ee-4f6d-afb2-b3bc4b181fae-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (5a9ec277-2907-41c5-b12c-af4bde78b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ada3245-a662-4fff-b91d-3f7c0ea4b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ada3245-a662-4fff-b91d-3f7c0ea4b89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781289764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198f8f38-e0f3-4504-a27e-21ef1c78a977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:40Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7ac15f-c901-4a5f-9598-647d2dc45f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7ac15f-c901-4a5f-9598-647d2dc45f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4823ed-228c-48fd-8615-3ab7e3f7b0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4823ed-228c-48fd-8615-3ab7e3f7b0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198f8f38-e0f3-4504-a27e-21ef1c78a977', 'volume_name': 'volume-198f8f38-e0f3-4504-a27e-21ef1c78a977', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a1e605-b92e-4069-905b-425b39615347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a1e605-b92e-4069-905b-425b39615347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b571a8c5-7063-4517-af60-4a67f57d7d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:39 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Volume 198f8f38-e0f3-4504-a27e-21ef1c78a977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198f8f38-e0f3-4504-a27e-21ef1c78a977', 'volume_size': 1} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781289764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198f8f38-e0f3-4504-a27e-21ef1c78a977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:40Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Creating volume 198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:39 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:33:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:39 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 1073741824 Jul 06 12:33:39 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:40 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 1073741824" returned: 0 in 0.968s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Flow 'volume_create_manager' (07a8e4fc-2f79-4c5b-8a3c-f97426999ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:40 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 Jul 06 12:33:40 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d70a5-3e49-40ec-bd5e-4ef5b760d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d70a5-3e49-40ec-bd5e-4ef5b760d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74dc0dba-3de7-4416-bdf0-671df2fc56cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77940603076147568e709a86dbd4ddf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=71264c1c-3e7a-49d1-945c-55a0cd710cdf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:33:41Z,use_quota=True,user_id='95b1065400174dcf93cfd6fb8380a95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8767429-1f99-44b8-ac30-1641740e39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8767429-1f99-44b8-ac30-1641740e39bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10657f1c-2846-4b3c-8b74-535846cc8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10657f1c-2846-4b3c-8b74-535846cc8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74dc0dba-3de7-4416-bdf0-671df2fc56cc', 'volume_name': 'volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc', 'volume_size': 1, 'snapshot_id': '71264c1c-3e7a-49d1-945c-55a0cd710cdf'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81ba8fb-0a70-4b49-a0a4-147045082fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81ba8fb-0a70-4b49-a0a4-147045082fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c68aa05-e834-4328-affe-4850e01cfc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:40 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Volume 74dc0dba-3de7-4416-bdf0-671df2fc56cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc', 'volume_size': 1, 'snapshot_id': '71264c1c-3e7a-49d1-945c-55a0cd710cdf'} Jul 06 12:33:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:41 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977" returned: 0 in 0.689s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.603s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-quobyte-71264c1c-3e7a-49d1-945c-55a0cd710cdf-74dc0dba-3de7-4416-bdf0-671df2fc56cc" by "_create_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b571a8c5-7063-4517-af60-4a67f57d7d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198f8f38-e0f3-4504-a27e-21ef1c78a977', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bed44d-5cef-4cb4-ac16-a80f5a0e31ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-71264c1c-3e7a-49d1-945c-55a0cd710cdf-74dc0dba-3de7-4416-bdf0-671df2fc56cc" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Creating volume 74dc0dba-3de7-4416-bdf0-671df2fc56cc from snapshot 71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-quobyte-74dc0dba-3de7-4416-bdf0-671df2fc56cc" by "_copy_volume_from_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:41 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Volume volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 (198f8f38-e0f3-4504-a27e-21ef1c78a977): created successfully Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bed44d-5cef-4cb4-ac16-a80f5a0e31ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (5a9ec277-2907-41c5-b12c-af4bde78b687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-74dc0dba-3de7-4416-bdf0-671df2fc56cc" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] snapshot: 71264c1c-3e7a-49d1-945c-55a0cd710cdf, volume: 74dc0dba-3de7-4416-bdf0-671df2fc56cc, {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-f706fcca-087b-4b33-a7b9-5a1c26fc7649 tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d375654-dfb0-4548-9eb4-b5151b00371d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:41 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf Jul 06 12:33:41 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:42 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf" returned: 0 in 0.773s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:33:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:33:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Creating direct copy from snapshot {{(pid=86706) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:33:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[7162969e-75a5-46d1-81fe-2c9581aeab88]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:42 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 Jul 06 12:33:42 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:43 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" returned: 0 in 0.723s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:43 devstack cinder-volume[86706]: DEBUG cinder.utils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Path /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc not found in is_blk_device check {{(pid=86706) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:33:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:43 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc Jul 06 12:33:43 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:47 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc" returned: 0 in 4.533s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:47 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd60717-7bae-49bf-8a91-f3e4ec956536]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:47 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 Jul 06 12:33:47 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:48 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" returned: 0 in 0.911s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:48 devstack cinder-volume[86706]: DEBUG cinder.image.image_utils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc {{(pid=86706) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:33:48 devstack cinder-volume[86706]: INFO cinder.image.image_utils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Converted 1024.00 MB image at 225.81 MB/s Jul 06 12:33:48 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc is being set with open permissions: ugo+rw Jul 06 12:33:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:48 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc Jul 06 12:33:48 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:49 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc" returned: 0 in 0.644s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-74dc0dba-3de7-4416-bdf0-671df2fc56cc" released by "_copy_volume_from_snapshot" :: held 7.672s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-71264c1c-3e7a-49d1-945c-55a0cd710cdf-74dc0dba-3de7-4416-bdf0-671df2fc56cc" released by "_create_volume_from_snapshot" :: held 7.718s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.748s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.275s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot a48a2d45-d06e-47ed-b3f6-e2a573645164 of volume 198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c68aa05-e834-4328-affe-4850e01cfc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc', 'volume_size': 1, 'snapshot_id': '71264c1c-3e7a-49d1-945c-55a0cd710cdf'}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439a230f-c9dd-4bbd-97bc-25c8ec397b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918a8bb-85fb-4c57-8d6f-ae72d7c56772]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:49 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Volume volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc (74dc0dba-3de7-4416-bdf0-671df2fc56cc): created successfully Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439a230f-c9dd-4bbd-97bc-25c8ec397b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Flow 'volume_create_manager' (07a8e4fc-2f79-4c5b-8a3c-f97426999ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:33:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-478bc4fa-9311-44ed-9bea-8c5e9386ec25 tempest-SnapshotDependencyTests-1600160658 None] Created volume successfully. Jul 06 12:33:49 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 Jul 06 12:33:49 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-71264c1c-3e7a-49d1-945c-55a0cd710cdf-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-71264c1c-3e7a-49d1-945c-55a0cd710cdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-quobyte-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-quobyte-71264c1c-3e7a-49d1-945c-55a0cd710cdf" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-71264c1c-3e7a-49d1-945c-55a0cd710cdf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Deleting offline snapshot 71264c1c-3e7a-49d1-945c-55a0cd710cdf of volume d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] snapshot_file for this snap is: volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc27a0-2999-4d4f-8b2f-294a0d18f747]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:49 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf Jul 06 12:33:49 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:50 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977" returned: 0 in 0.798s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:50 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 1G Jul 06 12:33:50 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:50 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf" returned: 0 in 0.790s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed102c-81a9-4a1b-9bb7-dec17faab302]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:50 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 Jul 06 12:33:50 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:50 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 1G" returned: 0 in 0.887s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:50 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 Jul 06 12:33:50 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:51 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:51 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf Jul 06 12:33:51 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:51 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164" returned: 0 in 0.703s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:51 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 is being set with open permissions: ugo+rw Jul 06 12:33:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:51 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 Jul 06 12:33:51 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:51 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf" returned: 0 in 0.792s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:51 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf Jul 06 12:33:51 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:52 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164" returned: 0 in 0.628s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:52 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.info Jul 06 12:33:52 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:52 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546.71264c1c-3e7a-49d1-945c-55a0cd710cdf" returned: 0 in 0.672s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-71264c1c-3e7a-49d1-945c-55a0cd710cdf" released by "_delete_snapshot" :: held 3.172s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" released by "delete_snapshot" :: held 3.196s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Created reservations ['8d149129-a0b2-4900-8532-59cbcc274cf9', '63060526-c461-4a64-a080-b9fa9b77d68e', 'e636e827-5efa-4f1d-a603-d6385c7960ef', 'c917414a-280c-47c8-8784-3e439c3ae2a0'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:52 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Delete snapshot completed successfully. Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4a62984f-936f-445c-aae1-d3afa405296c tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-71264c1c-3e7a-49d1-945c-55a0cd710cdf-delete_snapshot" released by "delete_snapshot" :: held 3.365s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:52 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.info" returned: 0 in 0.669s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:52 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.info is being set with open permissions: ugo+rw Jul 06 12:33:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:52 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.info Jul 06 12:33:52 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:53 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.info" returned: 0 in 0.640s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:53 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-58dd2210-c57b-49e7-a3aa-c49b30c0dd23 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-d76cc2ef-b16a-446b-8bb2-a92af9d4a546-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-d76cc2ef-b16a-446b-8bb2-a92af9d4a546-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-quobyte-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" acquired by "delete_volume" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3bb2d1-8f0d-47a9-8366-7fd957ec4d74]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:53 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 Jul 06 12:33:53 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-a48a2d45-d06e-47ed-b3f6-e2a573645164-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-a48a2d45-d06e-47ed-b3f6-e2a573645164-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-198f8f38-e0f3-4504-a27e-21ef1c78a977" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-198f8f38-e0f3-4504-a27e-21ef1c78a977" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-a48a2d45-d06e-47ed-b3f6-e2a573645164" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-a48a2d45-d06e-47ed-b3f6-e2a573645164" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot a48a2d45-d06e-47ed-b3f6-e2a573645164 of volume 198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46f6af6-5b27-49f8-8756-7b80d9203180]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:54 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" returned: 0 in 0.767s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:54 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546 Jul 06 12:33:54 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:54 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 Jul 06 12:33:54 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:55 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" returned: 0 in 0.645s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-d76cc2ef-b16a-446b-8bb2-a92af9d4a546" released by "delete_volume" :: held 1.471s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:55 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164" returned: 0 in 0.776s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f8f38-e0f3-4504-a27e-21ef1c78a977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Created reservations ['43b16806-c71d-4a3d-ae47-0fa4dc58a4ba', '63d357ac-b7b9-4017-a403-d71b7f8dc4e9', '7bd79e0d-c44f-493d-9a90-3493bc13b1c0', '252ac977-f9a4-4d07-9d0d-55afb789d477'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[8976a51a-67d0-40d5-aa7c-6dbe268b47c6]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:55 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:33:55 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:55 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 Jul 06 12:33:55 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-74dc0dba-3de7-4416-bdf0-671df2fc56cc-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-74dc0dba-3de7-4416-bdf0-671df2fc56cc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "cinder-quobyte-74dc0dba-3de7-4416-bdf0-671df2fc56cc" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-74dc0dba-3de7-4416-bdf0-671df2fc56cc" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[112f8865-8a7e-4897-961f-261ec9fe945e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:56 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.718s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Deleted volume successfully. Jul 06 12:33:56 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977" returned: 0 in 0.824s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-3651e34e-58d4-4ab2-a295-359aa5a109a6 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-d76cc2ef-b16a-446b-8bb2-a92af9d4a546-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:56 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 Jul 06 12:33:56 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:56 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc Jul 06 12:33:56 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:56 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc" returned: 0 in 0.816s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:56 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164" returned: 0 in 0.779s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:56 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc Jul 06 12:33:56 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:56 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164 Jul 06 12:33:56 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:57 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977.a48a2d45-d06e-47ed-b3f6-e2a573645164" returned: 0 in 0.660s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:57 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-74dc0dba-3de7-4416-bdf0-671df2fc56cc" returned: 0 in 0.706s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-a48a2d45-d06e-47ed-b3f6-e2a573645164" released by "_delete_snapshot" :: held 3.153s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-quobyte-74dc0dba-3de7-4416-bdf0-671df2fc56cc" released by "delete_volume" :: held 1.581s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-198f8f38-e0f3-4504-a27e-21ef1c78a977" released by "delete_snapshot" :: held 3.182s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Created reservations ['4d795f50-7ded-4a04-b7d4-cac169a47683', 'fa528916-a56a-4b41-8073-ed1f83d329cd', 'bd3b144a-7524-495a-bbbc-162075dda33e', '788a1545-da30-48e8-b642-1b0a0ec54664'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Created reservations ['4f2b9e9b-abf5-48c1-9a3a-cbf0bf84deb3', '5fa537e2-bc6f-4267-99fe-e7f6ee6c1c0c', '7d703445-d9d5-41e9-aa6a-616d09f4e17d', '71b61104-9947-463c-b829-2f961618773d'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:57 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:33:57 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:33:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ec8ad9a-71a8-4cf5-85ef-97b781ad9191 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-a48a2d45-d06e-47ed-b3f6-e2a573645164-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:58 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.639s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Deleted volume successfully. Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9ae1e72c-12d2-43f9-87ad-aa26f75b3f15 tempest-SnapshotDependencyTests-1600160658 None] Lock "cinder-74dc0dba-3de7-4416-bdf0-671df2fc56cc-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-198f8f38-e0f3-4504-a27e-21ef1c78a977-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-198f8f38-e0f3-4504-a27e-21ef1c78a977-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-198f8f38-e0f3-4504-a27e-21ef1c78a977" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-198f8f38-e0f3-4504-a27e-21ef1c78a977" acquired by "delete_volume" :: waited 0.013s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d363ca-c67c-4a8d-9353-2370ed438e80]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:59 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 Jul 06 12:33:59 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:59 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977" returned: 0 in 0.843s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:59 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977 Jul 06 12:33:59 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:00 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-198f8f38-e0f3-4504-a27e-21ef1c78a977" returned: 0 in 0.747s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-198f8f38-e0f3-4504-a27e-21ef1c78a977" released by "delete_volume" :: held 1.661s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Created reservations ['718d9436-57c0-4d5c-a344-58c97b8a1c95', 'cf029437-be12-43b9-9f46-f7eeb4d24ec0', 'bcda0955-815f-4256-8c07-9223e6c16f6e', '45ca0288-3b2a-49b8-bca4-8fab6a713bfb'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:00 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:34:00 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (e73ee835-a667-4887-8908-5160bcecafba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:01 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da1b028-2ea4-42d8-b0bf-58f040be718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.970s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da1b028-2ea4-42d8-b0bf-58f040be718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235812084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e421bc78-61a9-47e1-a24a-1977375d6e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:02Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d6f9c2-ad64-4acd-a3a0-43dab07507cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d6f9c2-ad64-4acd-a3a0-43dab07507cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dee048-7301-4650-92ce-340f1254f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dee048-7301-4650-92ce-340f1254f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e421bc78-61a9-47e1-a24a-1977375d6e0e', 'volume_name': 'volume-e421bc78-61a9-47e1-a24a-1977375d6e0e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7967142-ca34-4930-bf61-99fba195acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7967142-ca34-4930-bf61-99fba195acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce066053-9082-4153-9e5b-05826a1c9a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:01 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Volume e421bc78-61a9-47e1-a24a-1977375d6e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e421bc78-61a9-47e1-a24a-1977375d6e0e', 'volume_size': 1} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235812084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e421bc78-61a9-47e1-a24a-1977375d6e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:02Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Creating volume e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:01 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:01 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e 1073741824 Jul 06 12:34:01 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9839c9ca-125e-41fd-b12d-b0989a7e2832 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-198f8f38-e0f3-4504-a27e-21ef1c78a977-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:02 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e 1073741824" returned: 0 in 1.013s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:02 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e Jul 06 12:34:02 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:03 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce066053-9082-4153-9e5b-05826a1c9a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e421bc78-61a9-47e1-a24a-1977375d6e0e', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc000ff-4890-40d1-a134-badc57d8e40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:03 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Volume volume-e421bc78-61a9-47e1-a24a-1977375d6e0e (e421bc78-61a9-47e1-a24a-1977375d6e0e): created successfully Jul 06 12:34:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc000ff-4890-40d1-a134-badc57d8e40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:03 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (e73ee835-a667-4887-8908-5160bcecafba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:03 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-cb392e02-211a-41c7-b2f3-f4430fad9e97 tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:34:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot d853d544-2e21-48d5-88d3-aad0b07d678f of volume e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:34:04 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bb2114-012a-4647-901e-a4bb45dc34af]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:04 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e Jul 06 12:34:04 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:04 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e" returned: 0 in 0.801s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:04 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f 1G Jul 06 12:34:04 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:05 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f 1G" returned: 0 in 0.993s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e421bc78-61a9-47e1-a24a-1977375d6e0e -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:05 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e421bc78-61a9-47e1-a24a-1977375d6e0e -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f Jul 06 12:34:05 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:06 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e421bc78-61a9-47e1-a24a-1977375d6e0e -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f" returned: 0 in 0.770s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:06 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f is being set with open permissions: ugo+rw Jul 06 12:34:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:06 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f Jul 06 12:34:06 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:07 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f" returned: 0 in 0.712s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:07 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.info Jul 06 12:34:07 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:08 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.info" returned: 0 in 0.735s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:08 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.info is being set with open permissions: ugo+rw Jul 06 12:34:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:08 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.info Jul 06 12:34:08 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:08 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.info" returned: 0 in 0.749s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.856s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b256089c-7feb-4dab-8aff-fd2fd64adc66 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-d853d544-2e21-48d5-88d3-aad0b07d678f-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Lock "cinder-d853d544-2e21-48d5-88d3-aad0b07d678f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-e421bc78-61a9-47e1-a24a-1977375d6e0e" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-e421bc78-61a9-47e1-a24a-1977375d6e0e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-d853d544-2e21-48d5-88d3-aad0b07d678f" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-d853d544-2e21-48d5-88d3-aad0b07d678f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot d853d544-2e21-48d5-88d3-aad0b07d678f of volume e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada9de23-88ba-404a-8e14-66ad59c8470f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:09 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f Jul 06 12:34:09 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:10 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f" returned: 0 in 0.755s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e421bc78-61a9-47e1-a24a-1977375d6e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:34:10 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19e12fb-55aa-4497-a1d8-595de1d659e5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:10 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e Jul 06 12:34:10 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:10 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e" returned: 0 in 0.721s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:10 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f Jul 06 12:34:10 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:11 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f" returned: 0 in 0.746s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:11 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f Jul 06 12:34:11 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:12 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e.d853d544-2e21-48d5-88d3-aad0b07d678f" returned: 0 in 0.689s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-d853d544-2e21-48d5-88d3-aad0b07d678f" released by "_delete_snapshot" :: held 3.014s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-e421bc78-61a9-47e1-a24a-1977375d6e0e" released by "delete_snapshot" :: held 3.040s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:12 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Created reservations ['1a2eca9c-6322-4c13-b73d-ba1fc2468421', '7d7c88e9-3ea5-4068-9a1e-e1382b2b72c7', '7fc63e2e-c211-40db-accf-d54608182443', '66cf893e-982c-4869-8794-4e6950f5aacf'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:12 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:34:12 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-75c6d8de-8d39-42c0-8deb-8e1b9b55607d tempest-ProjectMemberTests-1317769893 None] Lock "cinder-d853d544-2e21-48d5-88d3-aad0b07d678f-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-e421bc78-61a9-47e1-a24a-1977375d6e0e-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-e421bc78-61a9-47e1-a24a-1977375d6e0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-e421bc78-61a9-47e1-a24a-1977375d6e0e" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:13 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-e421bc78-61a9-47e1-a24a-1977375d6e0e" acquired by "delete_volume" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:13 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10a57e1-ce4e-4c0a-b112-ec44f2dca67d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:13 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e Jul 06 12:34:13 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:14 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e" returned: 0 in 0.795s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:14 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e Jul 06 12:34:14 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:15 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-e421bc78-61a9-47e1-a24a-1977375d6e0e" returned: 0 in 0.710s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-e421bc78-61a9-47e1-a24a-1977375d6e0e" released by "delete_volume" :: held 1.562s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Created reservations ['cbc9ce30-5dbd-4706-b680-bb7e1de683b6', '1d2c0d9c-bc90-4636-83cc-2d175a555049', '1b5f595d-ce3a-4af9-ae50-7f045450682a', 'b1098ff3-2c10-4b12-a251-51066350f0b1'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:15 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:34:15 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:16 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.756s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:16 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-299201b3-1418-4750-a61a-ba6aa6095247 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-e421bc78-61a9-47e1-a24a-1977375d6e0e-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (be111f3c-e2cf-4767-92fb-63fd7e35333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9970068-0e0b-4c9c-bfb9-ccf7785ad53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9970068-0e0b-4c9c-bfb9-ccf7785ad53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055665039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fc596d-00eb-49ee-9306-bc00d69313fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:16Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0c57db-feb4-42b7-bd21-6ace2ca409e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0c57db-feb4-42b7-bd21-6ace2ca409e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4909cf7-f229-4d2e-8262-2806bede7a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4909cf7-f229-4d2e-8262-2806bede7a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fc596d-00eb-49ee-9306-bc00d69313fc', 'volume_name': 'volume-09fc596d-00eb-49ee-9306-bc00d69313fc', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e464ed39-f493-4814-90f9-fda4c7ac03cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e464ed39-f493-4814-90f9-fda4c7ac03cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6d2be4-2a44-4a12-b167-89e847d33b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:16 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Volume 09fc596d-00eb-49ee-9306-bc00d69313fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fc596d-00eb-49ee-9306-bc00d69313fc', 'volume_size': 1} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055665039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fc596d-00eb-49ee-9306-bc00d69313fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:16Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Creating volume 09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:16 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:34:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:16 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc 1073741824 Jul 06 12:34:16 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:17 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc 1073741824" returned: 0 in 0.921s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:17 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc Jul 06 12:34:17 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:17 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc" returned: 0 in 0.631s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6d2be4-2a44-4a12-b167-89e847d33b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fc596d-00eb-49ee-9306-bc00d69313fc', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:17 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c361cfcf-fd14-4bac-a0a7-d93e03710a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:18 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Volume volume-09fc596d-00eb-49ee-9306-bc00d69313fc (09fc596d-00eb-49ee-9306-bc00d69313fc): created successfully Jul 06 12:34:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c361cfcf-fd14-4bac-a0a7-d93e03710a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:18 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (be111f3c-e2cf-4767-92fb-63fd7e35333e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-004ffcd8-48d0-4100-a6fc-d852293ab579 tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:34:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:18 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot 9dc96888-4d0a-42e4-a573-798976846d5d of volume 09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:34:18 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e87f74-6299-4170-9c81-550f748080e8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:18 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc Jul 06 12:34:18 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:19 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:19 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d 1G Jul 06 12:34:19 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:20 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d 1G" returned: 0 in 0.814s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fc596d-00eb-49ee-9306-bc00d69313fc -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:20 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fc596d-00eb-49ee-9306-bc00d69313fc -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d Jul 06 12:34:20 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:20 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fc596d-00eb-49ee-9306-bc00d69313fc -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d" returned: 0 in 0.797s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:20 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d is being set with open permissions: ugo+rw Jul 06 12:34:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:20 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d Jul 06 12:34:20 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:21 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:21 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.info Jul 06 12:34:21 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:22 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.info" returned: 0 in 0.716s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:22 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.info is being set with open permissions: ugo+rw Jul 06 12:34:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:22 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.info Jul 06 12:34:22 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:23 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.info" returned: 0 in 0.680s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.610s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b7eee1ac-3e27-466a-bea2-725443945ecf tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-9dc96888-4d0a-42e4-a573-798976846d5d-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-9dc96888-4d0a-42e4-a573-798976846d5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-09fc596d-00eb-49ee-9306-bc00d69313fc" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-09fc596d-00eb-49ee-9306-bc00d69313fc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-9dc96888-4d0a-42e4-a573-798976846d5d" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-9dc96888-4d0a-42e4-a573-798976846d5d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot 9dc96888-4d0a-42e4-a573-798976846d5d of volume 09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18b95df-9da2-4f95-bd6b-4341f262007c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:23 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d Jul 06 12:34:23 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:24 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:24 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09fc596d-00eb-49ee-9306-bc00d69313fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:34:24 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3ca0f-05a5-4ad9-8681-01a85fb093e0]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:24 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc Jul 06 12:34:24 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:25 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc" returned: 0 in 0.765s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:25 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d Jul 06 12:34:25 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:26 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d" returned: 0 in 0.777s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:26 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d Jul 06 12:34:26 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:26 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc.9dc96888-4d0a-42e4-a573-798976846d5d" returned: 0 in 0.641s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-9dc96888-4d0a-42e4-a573-798976846d5d" released by "_delete_snapshot" :: held 3.068s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-09fc596d-00eb-49ee-9306-bc00d69313fc" released by "delete_snapshot" :: held 3.094s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:26 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Created reservations ['014f8ef1-a3b9-4912-858e-d20c50e6890b', '6e20d663-4abf-4917-bdbc-625f44898793', 'bc43f464-aecd-49e0-a1cd-9ac6c50298ba', '8636c669-6ac2-4093-83fd-90f6a4b1903a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:27 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:34:27 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:27 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-ca12dabc-8b39-4893-9053-9fc18d3606b4 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-9dc96888-4d0a-42e4-a573-798976846d5d-delete_snapshot" released by "delete_snapshot" :: held 3.270s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:27 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.651s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:34:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-09fc596d-00eb-49ee-9306-bc00d69313fc-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-09fc596d-00eb-49ee-9306-bc00d69313fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-09fc596d-00eb-49ee-9306-bc00d69313fc" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-09fc596d-00eb-49ee-9306-bc00d69313fc" acquired by "delete_volume" :: waited 0.013s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[403bac23-51e6-4197-8ec4-74001d61bf38]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:28 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc Jul 06 12:34:28 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:28 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc" returned: 0 in 0.763s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:28 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc Jul 06 12:34:29 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:29 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-09fc596d-00eb-49ee-9306-bc00d69313fc" returned: 0 in 0.634s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-09fc596d-00eb-49ee-9306-bc00d69313fc" released by "delete_volume" :: held 1.464s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Created reservations ['aecdcaf9-48e3-40cd-bf2b-f46e666d3e25', '6086308b-9419-4ed1-8950-69561e33bb48', 'f53b81d0-45dc-4a92-afc8-ca53ab856357', '12823ef3-b02f-4cb1-bc57-9563bb9fce85'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:29 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:34:29 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:30 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.788s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:30 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-99b84a90-8bc9-4189-9d1b-81e954a13008 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-09fc596d-00eb-49ee-9306-bc00d69313fc-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=78,cinder:UPDATE=97,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=81,cinder:UPDATE=98,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (62a54908-bf73-4357-8900-f871bf297df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868bb2ab-6979-47ec-8b22-a31493a04461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868bb2ab-6979-47ec-8b22-a31493a04461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534010994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b601ba-5d44-47f8-9489-c9463e5cb6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b601ba-5d44-47f8-9489-c9463e5cb6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b089169a-cd0a-40cc-a7ed-64396a0e8c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b089169a-cd0a-40cc-a7ed-64396a0e8c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d', 'volume_name': 'volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc81e99d-2772-41f1-b55c-631cfb4b628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc81e99d-2772-41f1-b55c-631cfb4b628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c0d84d-cad5-4ff6-82c5-4c3b0942e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:30 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Volume fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d', 'volume_size': 1} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534010994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:31Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Creating volume fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:30 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:34:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:30 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d 1073741824 Jul 06 12:34:30 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:31 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d 1073741824" returned: 0 in 0.831s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:31 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d Jul 06 12:34:31 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:32 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d" returned: 0 in 0.761s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:32 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c0d84d-cad5-4ff6-82c5-4c3b0942e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a2b147-0bfc-40aa-a36a-2ffb828e4577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:32 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Volume volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d (fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d): created successfully Jul 06 12:34:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a2b147-0bfc-40aa-a36a-2ffb828e4577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:32 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (62a54908-bf73-4357-8900-f871bf297df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:32 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-670704ee-54cd-4e18-82b8-b6488da6aecc tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:34:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:33 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot 5089e22d-b991-4233-9c90-84216d915b6c of volume fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:34:33 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9363dc-bbcc-42ee-a085-99207361d5ae]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:33 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d Jul 06 12:34:33 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:33 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d" returned: 0 in 0.834s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:33 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:33 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c 1G Jul 06 12:34:33 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:34 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c 1G" returned: 0 in 0.912s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:34 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c Jul 06 12:34:34 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:35 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c" returned: 0 in 0.782s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:35 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c is being set with open permissions: ugo+rw Jul 06 12:34:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:35 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c Jul 06 12:34:35 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:36 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.5089e22d-b991-4233-9c90-84216d915b6c" returned: 0 in 0.717s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:36 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.info Jul 06 12:34:36 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:37 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.info" returned: 0 in 0.668s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:37 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.info is being set with open permissions: ugo+rw Jul 06 12:34:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:37 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.info Jul 06 12:34:37 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:37 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-fe391ee9-4b88-47d5-9dbe-8f8ebc6d515d.info" returned: 0 in 0.706s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.704s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9c9df37f-3ab9-4f54-936b-638f54be36d2 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:34:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5198641-d73b-4116-9975-afa2c162dae0 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-5089e22d-b991-4233-9c90-84216d915b6c-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5198641-d73b-4116-9975-afa2c162dae0 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-5089e22d-b991-4233-9c90-84216d915b6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:38 devstack cinder-volume[86706]: INFO cinder.message.api [None req-b5198641-d73b-4116-9975-afa2c162dae0 tempest-ProjectMemberTests-1317769893 None] Creating message record for request_id = req-b5198641-d73b-4116-9975-afa2c162dae0 Jul 06 12:34:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-b5198641-d73b-4116-9975-afa2c162dae0 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-5089e22d-b991-4233-9c90-84216d915b6c-delete_snapshot" released by "delete_snapshot" :: held 0.035s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server [None req-b5198641-d73b-4116-9975-afa2c162dae0 tempest-ProjectMemberTests-1317769893 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:34:38 devstack cinder-volume[86706]: ERROR oslo_messaging.rpc.server Jul 06 12:34:48 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:48 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:27 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:35:27 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:27 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.641s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:35:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:35:47 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:47 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:27 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:36:27 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:27 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.679s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:36:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (0871ab1f-b49b-463a-a71e-6321dc3a5791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8ee8da-7d0f-4f5b-8df3-aa0ffded480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8ee8da-7d0f-4f5b-8df3-aa0ffded480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523289296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:40Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af824865-06be-41d9-9ada-482dd98d12a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af824865-06be-41d9-9ada-482dd98d12a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe926389-e49a-4e41-81ef-4dc34b06a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe926389-e49a-4e41-81ef-4dc34b06a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd', 'volume_name': 'volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eccba45-9bc6-4170-837c-20876d113076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eccba45-9bc6-4170-837c-20876d113076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd2a00-b0e4-4d4f-b26f-6357824cec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:39 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Volume 1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd', 'volume_size': 1} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523289296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:40Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Creating volume 1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:39 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:36:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:40 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd 1073741824 Jul 06 12:36:40 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:40 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd 1073741824" returned: 0 in 0.832s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:40 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd Jul 06 12:36:40 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:41 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" returned: 0 in 0.673s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd2a00-b0e4-4d4f-b26f-6357824cec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5dab02-2ac5-4935-b4c9-2e76655383e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:41 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Volume volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd (1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd): created successfully Jul 06 12:36:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5dab02-2ac5-4935-b4c9-2e76655383e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (0871ab1f-b49b-463a-a71e-6321dc3a5791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7a96bc55-55dd-462f-ad0e-6e98b0aac6a3 tempest-ProjectReaderTests-324280341 None] Created volume successfully. Jul 06 12:36:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Creating offline snapshot ad5b2f94-fef0-4e53-85ce-a767cff95667 of volume 1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[afafb623-238f-4e43-b51f-4b241a541406]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:42 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd Jul 06 12:36:42 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:42 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" returned: 0 in 0.775s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:42 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 1G Jul 06 12:36:42 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:43 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 1G" returned: 0 in 0.871s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:43 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 Jul 06 12:36:43 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:44 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667" returned: 0 in 0.698s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:44 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 is being set with open permissions: ugo+rw Jul 06 12:36:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:44 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 Jul 06 12:36:44 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:45 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667" returned: 0 in 0.632s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:45 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.info Jul 06 12:36:45 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:45 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.info" returned: 0 in 0.640s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:45 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.info is being set with open permissions: ugo+rw Jul 06 12:36:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:45 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.info Jul 06 12:36:45 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:46 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.info" returned: 0 in 0.695s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.396s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-dc1629b6-edc8-47e4-851b-38ea4b103be4 tempest-ProjectReaderTests-324280341 None] Create snapshot completed successfully Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-ad5b2f94-fef0-4e53-85ce-a767cff95667-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Lock "cinder-ad5b2f94-fef0-4e53-85ce-a767cff95667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-ad5b2f94-fef0-4e53-85ce-a767cff95667" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-ad5b2f94-fef0-4e53-85ce-a767cff95667" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Deleting offline snapshot ad5b2f94-fef0-4e53-85ce-a767cff95667 of volume 1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] snapshot_file for this snap is: volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10ef764-113c-46eb-b532-b4acdfeeec12]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:47 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 Jul 06 12:36:47 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:48 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667" returned: 0 in 0.750s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:36:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[af949937-6c14-46e6-af18-541d0a9d91e5]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:48 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd Jul 06 12:36:48 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:49 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" returned: 0 in 0.759s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:49 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 Jul 06 12:36:49 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:49 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667" returned: 0 in 0.772s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:49 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667 Jul 06 12:36:49 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:50 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd.ad5b2f94-fef0-4e53-85ce-a767cff95667" returned: 0 in 0.657s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-ad5b2f94-fef0-4e53-85ce-a767cff95667" released by "_delete_snapshot" :: held 3.038s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" released by "delete_snapshot" :: held 3.060s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:50 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Created reservations ['bc8cde11-3a62-43c8-8bbd-fd79aa3c1f85', 'add5aea2-f370-4bcf-af85-100248ab3588', 'b3cb0bb2-ff6b-420c-a457-cf2770cb673f', 'a8a01bf0-0467-491c-983f-18c5e8b6580b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:50 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Delete snapshot completed successfully. Jul 06 12:36:50 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2235119a-1448-424c-bf5a-f172e462d8fb tempest-ProjectReaderTests-324280341 None] Lock "cinder-ad5b2f94-fef0-4e53-85ce-a767cff95667-delete_snapshot" released by "delete_snapshot" :: held 3.225s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Lock "cinder-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:51 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8f0b8-f540-4a38-95f1-9c533250ab7a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:51 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd Jul 06 12:36:51 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:52 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" returned: 0 in 0.771s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:52 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd Jul 06 12:36:52 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:53 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" returned: 0 in 0.657s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd" released by "delete_volume" :: held 1.482s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Created reservations ['9f695769-36c7-4208-a8a8-e88681455019', '0bd24dba-3dc9-4375-8474-7badd2b008ff', '7973f70c-f71a-4292-a829-d93cf1f310fd', 'e34891ef-7f3d-484f-ae09-970dc11e90fc'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:53 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:36:53 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:54 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.718s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:54 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Deleted volume successfully. Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-5cd9d198-99e9-4efc-abcf-fd6aa0eb3a59 tempest-ProjectReaderTests-324280341 None] Lock "cinder-1ecf7ad2-f8cc-4a00-946b-cc85c0f287fd-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (db4bb1d3-3c31-423a-8ec8-a88fc2472dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161f45b-3a37-4916-9b20-93b4d4e5be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161f45b-3a37-4916-9b20-93b4d4e5be3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1757350242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:54Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087796f7-1357-4594-9876-d91406441ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087796f7-1357-4594-9876-d91406441ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354ff4ae-63b8-419c-a3bb-702f4acf9ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354ff4ae-63b8-419c-a3bb-702f4acf9ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31', 'volume_name': 'volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a4ade6-4b78-4e91-92b0-f866b1d2496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a4ade6-4b78-4e91-92b0-f866b1d2496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a17e4c-eee2-4134-9f8c-8af6f93f5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:54 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Volume c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31', 'volume_size': 1} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1757350242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:54Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Creating volume c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:54 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:36:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:54 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 1073741824 Jul 06 12:36:54 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:55 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 1073741824" returned: 0 in 0.825s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:55 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 Jul 06 12:36:55 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:56 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" returned: 0 in 0.689s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a17e4c-eee2-4134-9f8c-8af6f93f5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebf4ac7-11f1-4bd4-8cf7-4c06e20f8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Volume volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 (c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31): created successfully Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebf4ac7-11f1-4bd4-8cf7-4c06e20f8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (db4bb1d3-3c31-423a-8ec8-a88fc2472dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4ea10d12-82e3-4122-a7aa-ab4b511ffc85 tempest-ProjectReaderTests-324280341 None] Created volume successfully. Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Creating offline snapshot 5af5aa70-1906-43ba-bd29-009cd1a66bd4 of volume c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[624bd96c-0851-433b-b2d7-c07124da3964]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:56 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 Jul 06 12:36:56 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:57 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" returned: 0 in 0.744s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:57 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 1G Jul 06 12:36:57 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:58 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 1G" returned: 0 in 0.890s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:58 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 Jul 06 12:36:58 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:59 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4" returned: 0 in 0.773s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:59 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 is being set with open permissions: ugo+rw Jul 06 12:36:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:59 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 Jul 06 12:36:59 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:59 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4" returned: 0 in 0.690s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:59 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.info Jul 06 12:36:59 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:00 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.info" returned: 0 in 0.658s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:00 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.info is being set with open permissions: ugo+rw Jul 06 12:37:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:00 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.info Jul 06 12:37:00 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:01 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.info" returned: 0 in 0.638s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.472s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:01 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7d0d2b79-b1a8-4ed5-8e69-8d13dfd5b7cc tempest-ProjectReaderTests-324280341 None] Create snapshot completed successfully Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-5af5aa70-1906-43ba-bd29-009cd1a66bd4-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Lock "cinder-5af5aa70-1906-43ba-bd29-009cd1a66bd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-5af5aa70-1906-43ba-bd29-009cd1a66bd4" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-5af5aa70-1906-43ba-bd29-009cd1a66bd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:01 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Deleting offline snapshot 5af5aa70-1906-43ba-bd29-009cd1a66bd4 of volume c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:37:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] snapshot_file for this snap is: volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:37:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[501c1166-9945-4163-827c-955345664d7d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:02 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 Jul 06 12:37:02 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:02 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4" returned: 0 in 0.908s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:02 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:37:02 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2c9c8-fbbd-47d9-93dd-9148f7bc4053]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:03 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 Jul 06 12:37:03 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:03 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" returned: 0 in 0.811s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:03 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 Jul 06 12:37:03 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:04 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4" returned: 0 in 0.846s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:04 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4 Jul 06 12:37:04 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:05 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31.5af5aa70-1906-43ba-bd29-009cd1a66bd4" returned: 0 in 0.736s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-5af5aa70-1906-43ba-bd29-009cd1a66bd4" released by "_delete_snapshot" :: held 3.429s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" released by "delete_snapshot" :: held 3.453s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:05 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Created reservations ['7bb3c6d1-0dac-4be0-8e18-cabad7f7c049', 'd8e1e5cf-c780-4595-a5a9-e2f16b626218', '3841e124-6362-40e4-8106-e43b6ae90b57', '5c3dd14f-14a6-4624-9e17-f2f02f77a981'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:05 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Delete snapshot completed successfully. Jul 06 12:37:05 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-950dad3a-b844-4f32-bf1e-5b551a9be546 tempest-ProjectReaderTests-324280341 None] Lock "cinder-5af5aa70-1906-43ba-bd29-009cd1a66bd4-delete_snapshot" released by "delete_snapshot" :: held 3.622s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Lock "cinder-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:06 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f8c945-417d-482e-b479-093c400008a8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:06 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 Jul 06 12:37:06 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:07 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" returned: 0 in 0.839s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:07 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31 Jul 06 12:37:07 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:07 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" returned: 0 in 0.689s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31" released by "delete_volume" :: held 1.589s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Created reservations ['3ae6b5a2-e0fe-446b-aa1c-97a1b8db9a04', '81ce0cb2-80db-4614-a04a-fd488fb38b38', '2a6f91de-a2e5-4812-bf25-ea405d54dada', '67049cf6-b461-4268-8c8d-5645fdf2c613'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:08 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:37:08 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:08 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.779s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:08 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:08 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Deleted volume successfully. Jul 06 12:37:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4ce311fc-681e-4e7b-a0f8-3a01c5ecf3fd tempest-ProjectReaderTests-324280341 None] Lock "cinder-c9ec70a2-9d8f-4667-8ed9-c0ae7f815e31-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:08 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (437e3314-b0fc-41bf-9970-47ac8841ac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:08 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60c606c-7f7a-4290-94b3-af6475cd777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60c606c-7f7a-4290-94b3-af6475cd777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912163407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76ea93b-5d04-4663-b650-33c555ec15b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:09Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba36e51-6907-4f4d-8e4a-5a939d36bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba36e51-6907-4f4d-8e4a-5a939d36bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0a70d5-5ddf-476c-bb5f-10739b754538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0a70d5-5ddf-476c-bb5f-10739b754538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76ea93b-5d04-4663-b650-33c555ec15b9', 'volume_name': 'volume-a76ea93b-5d04-4663-b650-33c555ec15b9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf90a968-8f20-44ae-b141-48e65b7d8dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf90a968-8f20-44ae-b141-48e65b7d8dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1720e47-b344-4e88-9de9-72586fd954b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:09 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Volume a76ea93b-5d04-4663-b650-33c555ec15b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76ea93b-5d04-4663-b650-33c555ec15b9', 'volume_size': 1} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912163407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76ea93b-5d04-4663-b650-33c555ec15b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6183f69377b4c958403cef70f13a1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:09Z,use_quota=True,user_id='0c1f3af0c9ca4481ae258481085970b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Creating volume a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:09 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:09 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 1073741824 Jul 06 12:37:09 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:09 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 1073741824" returned: 0 in 0.796s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:09 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 Jul 06 12:37:09 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:10 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9" returned: 0 in 0.736s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1720e47-b344-4e88-9de9-72586fd954b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76ea93b-5d04-4663-b650-33c555ec15b9', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d2a800-62b1-41bd-8a56-ba757bcf484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:10 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Volume volume-a76ea93b-5d04-4663-b650-33c555ec15b9 (a76ea93b-5d04-4663-b650-33c555ec15b9): created successfully Jul 06 12:37:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d2a800-62b1-41bd-8a56-ba757bcf484e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:10 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Flow 'volume_create_manager' (437e3314-b0fc-41bf-9970-47ac8841ac3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:10 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-fa70c9de-8b05-42fe-8f5a-d493842ede13 tempest-ProjectReaderTests-324280341 None] Created volume successfully. Jul 06 12:37:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Creating offline snapshot cbe68810-8efc-435a-ad61-89d9bdacab5a of volume a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:37:11 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ef7a4-0fdc-45f1-8689-29ee48f96381]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:11 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 Jul 06 12:37:11 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:12 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9" returned: 0 in 0.809s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:12 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a 1G Jul 06 12:37:12 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:13 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a 1G" returned: 0 in 0.901s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76ea93b-5d04-4663-b650-33c555ec15b9 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:13 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76ea93b-5d04-4663-b650-33c555ec15b9 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a Jul 06 12:37:13 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:13 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a76ea93b-5d04-4663-b650-33c555ec15b9 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a" returned: 0 in 0.770s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:13 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a is being set with open permissions: ugo+rw Jul 06 12:37:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:13 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a Jul 06 12:37:13 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:14 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a" returned: 0 in 0.658s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:14 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.info Jul 06 12:37:14 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:15 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.info" returned: 0 in 0.697s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:15 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.info is being set with open permissions: ugo+rw Jul 06 12:37:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:15 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.info Jul 06 12:37:15 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:15 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.info" returned: 0 in 0.671s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.594s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:15 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-ac453409-9471-4ae8-9b85-54f92f789adb tempest-ProjectReaderTests-324280341 None] Create snapshot completed successfully Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-cbe68810-8efc-435a-ad61-89d9bdacab5a-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Lock "cinder-cbe68810-8efc-435a-ad61-89d9bdacab5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-a76ea93b-5d04-4663-b650-33c555ec15b9" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-a76ea93b-5d04-4663-b650-33c555ec15b9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-cbe68810-8efc-435a-ad61-89d9bdacab5a" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-cbe68810-8efc-435a-ad61-89d9bdacab5a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Deleting offline snapshot cbe68810-8efc-435a-ad61-89d9bdacab5a of volume a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] snapshot_file for this snap is: volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad19c0-4eb1-45be-b390-78144a82cc50]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:16 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a Jul 06 12:37:16 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:17 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a" returned: 0 in 0.779s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:17 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a76ea93b-5d04-4663-b650-33c555ec15b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:37:17 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3ff4c2-acf7-4d18-b1b7-6be1e0240f7f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:17 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 Jul 06 12:37:17 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:18 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9" returned: 0 in 0.846s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:18 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a Jul 06 12:37:18 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:19 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a" returned: 0 in 0.793s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:19 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a Jul 06 12:37:19 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:19 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9.cbe68810-8efc-435a-ad61-89d9bdacab5a" returned: 0 in 0.663s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-cbe68810-8efc-435a-ad61-89d9bdacab5a" released by "_delete_snapshot" :: held 3.179s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-a76ea93b-5d04-4663-b650-33c555ec15b9" released by "delete_snapshot" :: held 3.206s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:19 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Created reservations ['ee89dc68-c441-4a3a-b687-54c11bd5a1b9', '7e986424-e700-421f-b52a-1df0bf4546d8', '21a050cb-1175-47d2-968d-2f4cdd362e0c', '7adfc308-915f-4f47-83cc-9b97ca5a59f8'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:19 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Delete snapshot completed successfully. Jul 06 12:37:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-83f11cea-039c-4ae0-aafc-b7893c7c6aa5 tempest-ProjectReaderTests-324280341 None] Lock "cinder-cbe68810-8efc-435a-ad61-89d9bdacab5a-delete_snapshot" released by "delete_snapshot" :: held 3.352s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-a76ea93b-5d04-4663-b650-33c555ec15b9-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Lock "cinder-a76ea93b-5d04-4663-b650-33c555ec15b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Acquiring lock "cinder-quobyte-a76ea93b-5d04-4663-b650-33c555ec15b9" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:20 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-a76ea93b-5d04-4663-b650-33c555ec15b9" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:20 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eaffb1-50ae-43b1-8931-f76f03e61c04]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:20 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 Jul 06 12:37:20 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:21 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9" returned: 0 in 0.799s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:21 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9 Jul 06 12:37:21 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:22 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-a76ea93b-5d04-4663-b650-33c555ec15b9" returned: 0 in 0.670s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Lock "cinder-quobyte-a76ea93b-5d04-4663-b650-33c555ec15b9" released by "delete_volume" :: held 1.531s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Created reservations ['090bbe15-9c05-4ee3-bae3-403f8250113c', '72e77bc2-f2c7-4a7b-aa7c-7d41c368e6a2', '1ef2a127-7204-4c27-a959-f552f642e468', 'db90bccd-742a-481e-bcf2-475d370bb159'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:22 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:37:22 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:23 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.695s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:23 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:23 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Deleted volume successfully. Jul 06 12:37:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-bdfcd51f-34a0-4d1e-be26-301bc4311d7c tempest-ProjectReaderTests-324280341 None] Lock "cinder-a76ea93b-5d04-4663-b650-33c555ec15b9-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:27 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:37:27 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:27 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.732s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:37:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:37:32 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=39,cinder:UPDATE=58,cinder:DELETE=5,cinder:INSERT=13 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:33 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=45,cinder:UPDATE=50,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (a093e37a-fed2-4932-ad4d-16182f053e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f601fa40-defa-4a7f-83b6-4548a0146636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f601fa40-defa-4a7f-83b6-4548a0146636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229459359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6491ec74-c246-4cfe-81b1-bc6b1e14e6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:40Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73373b48-9364-40f3-b148-1b5abd433653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73373b48-9364-40f3-b148-1b5abd433653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3522fa8-5de4-4bce-8607-aeba1134e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3522fa8-5de4-4bce-8607-aeba1134e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6491ec74-c246-4cfe-81b1-bc6b1e14e6de', 'volume_name': 'volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd7eff1-a6c7-4c8a-822b-78618e892d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd7eff1-a6c7-4c8a-822b-78618e892d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e62727-709d-4238-8230-ad4210b25305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:40 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Volume 6491ec74-c246-4cfe-81b1-bc6b1e14e6de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de', 'volume_size': 1} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229459359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6491ec74-c246-4cfe-81b1-bc6b1e14e6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:40Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Creating volume 6491ec74-c246-4cfe-81b1-bc6b1e14e6de {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:40 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:37:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:40 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de 1073741824 Jul 06 12:37:40 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:41 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de 1073741824" returned: 0 in 0.836s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:41 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de Jul 06 12:37:41 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:41 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de" returned: 0 in 0.648s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e62727-709d-4238-8230-ad4210b25305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c087b1-4af3-47fd-a48a-fecaef239c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:41 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Volume volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de (6491ec74-c246-4cfe-81b1-bc6b1e14e6de): created successfully Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c087b1-4af3-47fd-a48a-fecaef239c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (a093e37a-fed2-4932-ad4d-16182f053e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:41 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4d77d576-68b4-4200-9444-93b2c7913649 tempest-ProjectReaderTests-595066516 None] Created volume successfully. Jul 06 12:37:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-6491ec74-c246-4cfe-81b1-bc6b1e14e6de-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Lock "cinder-6491ec74-c246-4cfe-81b1-bc6b1e14e6de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-quobyte-6491ec74-c246-4cfe-81b1-bc6b1e14e6de" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:42 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-6491ec74-c246-4cfe-81b1-bc6b1e14e6de" acquired by "delete_volume" :: waited 0.012s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:42 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71c2402-ba66-4860-8d34-aab50032b1b8]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:42 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de Jul 06 12:37:42 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:43 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de" returned: 0 in 0.794s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:43 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de Jul 06 12:37:43 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:43 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-6491ec74-c246-4cfe-81b1-bc6b1e14e6de" returned: 0 in 0.638s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-6491ec74-c246-4cfe-81b1-bc6b1e14e6de" released by "delete_volume" :: held 1.476s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Created reservations ['03f1f502-ae58-4b92-a318-0a87e037d618', '6b42a439-ceb1-4324-9835-6618b586e676', '9a861603-f476-450c-900f-f397e2be51b5', '7c0fd041-ad5a-4fe6-8326-1be375ded823'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:43 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:37:43 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:44 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.697s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:44 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:44 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Deleted volume successfully. Jul 06 12:37:44 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-4383af9c-b4f8-4afb-92a4-b61cc4b18967 tempest-ProjectReaderTests-595066516 None] Lock "cinder-6491ec74-c246-4cfe-81b1-bc6b1e14e6de-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (6ba15da4-37e3-43f9-b9ce-b83a2819ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27779c93-f354-4f3e-b784-3f2ce7a250a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27779c93-f354-4f3e-b784-3f2ce7a250a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925940485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:45Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef53799b-d167-421e-b3c0-267367d10cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef53799b-d167-421e-b3c0-267367d10cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2716e1c-214b-44c8-a3ce-a1d7dbe8a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2716e1c-214b-44c8-a3ce-a1d7dbe8a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6', 'volume_name': 'volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef269cc3-d9e7-4b3c-9061-97a3d85e9ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef269cc3-d9e7-4b3c-9061-97a3d85e9ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cb269e-d15d-4794-9082-8a71f4526d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:45 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Volume f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6', 'volume_size': 1} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925940485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:45Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Creating volume f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:45 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:37:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:45 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 1073741824 Jul 06 12:37:45 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:46 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 1073741824" returned: 0 in 0.877s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:46 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 Jul 06 12:37:46 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:46 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6" returned: 0 in 0.692s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cb269e-d15d-4794-9082-8a71f4526d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b6d863-e239-42a1-913a-7ece4850854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:46 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Volume volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 (f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6): created successfully Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b6d863-e239-42a1-913a-7ece4850854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:46 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (6ba15da4-37e3-43f9-b9ce-b83a2819ef15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:46 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-78a043fa-7d4c-4f5f-aa89-588ef93f5888 tempest-ProjectReaderTests-595066516 None] Created volume successfully. Jul 06 12:37:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Lock "cinder-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-quobyte-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:47 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:47 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9176652-6348-471b-b348-3566939bac9c]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:47 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 Jul 06 12:37:47 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:48 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6" returned: 0 in 0.843s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:48 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6 Jul 06 12:37:48 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:48 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6" returned: 0 in 0.690s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6" released by "delete_volume" :: held 1.584s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:48 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Created reservations ['053c4d33-b130-477a-8032-73b7971ce598', '63273b26-a1f8-420e-9fb9-ea8b9d7f0249', '653f72ed-d77e-46e4-bb81-b6386423e0fb', '8cd9c9e3-cb72-44df-a7e3-f68f3a108191'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:49 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:37:49 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:49 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.796s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:49 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Deleted volume successfully. Jul 06 12:37:49 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2f346c35-e09e-4c57-8f2a-a2d3de49e15c tempest-ProjectReaderTests-595066516 None] Lock "cinder-f969c04e-6e9b-4ad7-9d7e-69f2a632cfc6-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (36ac301e-75eb-4895-8d44-c66e411fa365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00a553f-6f5e-4e99-aa95-346d0ecefa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00a553f-6f5e-4e99-aa95-346d0ecefa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661581699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4836e79-8f8c-466b-9504-c792792bdbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:50Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3790be2-bf31-4535-bdf0-617a1ecac2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3790be2-bf31-4535-bdf0-617a1ecac2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f65752-463d-458f-8bef-dd8e4c3d5ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f65752-463d-458f-8bef-dd8e4c3d5ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4836e79-8f8c-466b-9504-c792792bdbc7', 'volume_name': 'volume-d4836e79-8f8c-466b-9504-c792792bdbc7', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83675eba-dbe3-4f12-b0c6-6bae095c4d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83675eba-dbe3-4f12-b0c6-6bae095c4d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471a50ae-f88c-434f-b9ae-73f9be9def1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:50 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Volume d4836e79-8f8c-466b-9504-c792792bdbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4836e79-8f8c-466b-9504-c792792bdbc7', 'volume_size': 1} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661581699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4836e79-8f8c-466b-9504-c792792bdbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:50Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Creating volume d4836e79-8f8c-466b-9504-c792792bdbc7 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:50 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:37:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:50 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 1073741824 Jul 06 12:37:50 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:51 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 1073741824" returned: 0 in 0.913s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:51 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 Jul 06 12:37:51 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:51 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7" returned: 0 in 0.723s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471a50ae-f88c-434f-b9ae-73f9be9def1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4836e79-8f8c-466b-9504-c792792bdbc7', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95f3902-4069-4dca-aa91-60974ca394b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:51 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Volume volume-d4836e79-8f8c-466b-9504-c792792bdbc7 (d4836e79-8f8c-466b-9504-c792792bdbc7): created successfully Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95f3902-4069-4dca-aa91-60974ca394b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:51 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (36ac301e-75eb-4895-8d44-c66e411fa365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:51 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8a337ab1-657b-4bee-9155-e194e62a20d2 tempest-ProjectReaderTests-595066516 None] Created volume successfully. Jul 06 12:37:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-d4836e79-8f8c-466b-9504-c792792bdbc7-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Lock "cinder-d4836e79-8f8c-466b-9504-c792792bdbc7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-quobyte-d4836e79-8f8c-466b-9504-c792792bdbc7" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-d4836e79-8f8c-466b-9504-c792792bdbc7" acquired by "delete_volume" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b11cc2-180e-4ed6-8a15-865dad55c5d6]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:52 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 Jul 06 12:37:52 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:53 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7" returned: 0 in 0.870s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:53 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7 Jul 06 12:37:53 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:53 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-d4836e79-8f8c-466b-9504-c792792bdbc7" returned: 0 in 0.701s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:53 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-d4836e79-8f8c-466b-9504-c792792bdbc7" released by "delete_volume" :: held 1.613s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:53 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Created reservations ['86280ab0-40ce-430c-ba42-882725ca46f9', '6de7794b-79d7-4581-9fd1-36cfd5bca18d', '60619be8-9efc-4d5c-8e2f-046d431c502b', '49ebbc2e-c397-4fa9-a808-0dc2b3fd47fa'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:54 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:37:54 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:54 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.702s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:54 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Deleted volume successfully. Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-33cd7233-c325-488d-88ac-9d53a4e161f1 tempest-ProjectReaderTests-595066516 None] Lock "cinder-d4836e79-8f8c-466b-9504-c792792bdbc7-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:54 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (f5c659ef-426c-4dd8-9269-bcd6cf6b05e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3b01c3-58f3-4916-8066-ec0af4594cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3b01c3-58f3-4916-8066-ec0af4594cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795369797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722c7b16-24b0-4923-bfef-299cbb80a7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:55Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2dd1ab9-c7a2-4257-8d66-57a3e4eda385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2dd1ab9-c7a2-4257-8d66-57a3e4eda385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a939efab-9f88-4b63-9453-4fafd181fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a939efab-9f88-4b63-9453-4fafd181fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722c7b16-24b0-4923-bfef-299cbb80a7f2', 'volume_name': 'volume-722c7b16-24b0-4923-bfef-299cbb80a7f2', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e37435-9192-43a1-8469-3967c3c7ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e37435-9192-43a1-8469-3967c3c7ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4148857c-bb60-4254-93e5-a1a3a83d39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Volume 722c7b16-24b0-4923-bfef-299cbb80a7f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722c7b16-24b0-4923-bfef-299cbb80a7f2', 'volume_size': 1} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795369797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722c7b16-24b0-4923-bfef-299cbb80a7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab31fb8a2924d0faed58a99011bfb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:55Z,use_quota=True,user_id='f5be79e8ef344d189cb30dd043738cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Creating volume 722c7b16-24b0-4923-bfef-299cbb80a7f2 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:55 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:55 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 1073741824 Jul 06 12:37:55 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (e711c03c-384d-45f7-af15-98dd6c5aff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ae0c32-5c4c-4813-b3b1-e1fb23c095f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ae0c32-5c4c-4813-b3b1-e1fb23c095f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605770422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:56Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf012c0-d1a4-44fc-a5f8-a29f5fceea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf012c0-d1a4-44fc-a5f8-a29f5fceea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d24b653-43a3-45c0-9a5e-8ce0a1f69774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d24b653-43a3-45c0-9a5e-8ce0a1f69774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f', 'volume_name': 'volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd6bd24-4c87-4c50-95aa-0d408ead64dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd6bd24-4c87-4c50-95aa-0d408ead64dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b821ee-97b9-4c66-af7f-20e51a801f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Volume bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f', 'volume_size': 1} Jul 06 12:37:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:56 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 1073741824" returned: 0 in 0.961s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:56 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 Jul 06 12:37:56 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:56 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2" returned: 0 in 0.667s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605770422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:56Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Creating volume bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:56 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:56 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f 1073741824 Jul 06 12:37:56 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4148857c-bb60-4254-93e5-a1a3a83d39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722c7b16-24b0-4923-bfef-299cbb80a7f2', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5f3057-c0b2-420d-83f8-5d12a7bba993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:56 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Volume volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 (722c7b16-24b0-4923-bfef-299cbb80a7f2): created successfully Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5f3057-c0b2-420d-83f8-5d12a7bba993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:56 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Flow 'volume_create_manager' (f5c659ef-426c-4dd8-9269-bcd6cf6b05e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:56 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-7bd3ff1f-38fc-437c-9731-ef765f03e08e tempest-ProjectReaderTests-595066516 None] Created volume successfully. Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-722c7b16-24b0-4923-bfef-299cbb80a7f2-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Lock "cinder-722c7b16-24b0-4923-bfef-299cbb80a7f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Acquiring lock "cinder-quobyte-722c7b16-24b0-4923-bfef-299cbb80a7f2" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-722c7b16-24b0-4923-bfef-299cbb80a7f2" acquired by "delete_volume" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d90470f-0f9e-47a1-a9d9-7198af74e45f]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:57 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 Jul 06 12:37:57 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:57 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f 1073741824" returned: 0 in 0.959s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:57 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f Jul 06 12:37:57 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:58 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2" returned: 0 in 0.925s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:58 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2 Jul 06 12:37:58 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:58 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" returned: 0 in 0.745s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b821ee-97b9-4c66-af7f-20e51a801f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef2fcec-8ce5-41f0-a67a-aade76ff3cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:58 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Volume volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f (bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f): created successfully Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef2fcec-8ce5-41f0-a67a-aade76ff3cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (e711c03c-384d-45f7-af15-98dd6c5aff99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:58 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-08325f2b-9750-4a22-ad5a-c34c08cda9e9 tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:37:58 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-722c7b16-24b0-4923-bfef-299cbb80a7f2" returned: 0 in 0.754s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:58 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Lock "cinder-quobyte-722c7b16-24b0-4923-bfef-299cbb80a7f2" released by "delete_volume" :: held 1.736s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Created reservations ['7304f278-a9e2-4a0a-91b6-9868ca86817d', 'f4986a3e-9a64-4150-bf3c-affdec07ca70', '51756ae4-38ff-41fb-a5ab-57df7d09cdd2', 'a3d3def3-4b75-4317-aca8-dae8cff0a840'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot 12d14e3c-41c4-4628-bf76-816db79d28da of volume bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e5a640-557f-442a-a29c-f1d790d1ec5e]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:59 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:37:59 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:59 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f Jul 06 12:37:59 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:59 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.778s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:59 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Deleted volume successfully. Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-9dc358d6-0166-457b-8458-53c16d8c8713 tempest-ProjectReaderTests-595066516 None] Lock "cinder-722c7b16-24b0-4923-bfef-299cbb80a7f2-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:59 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" returned: 0 in 0.895s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:00 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da 1G Jul 06 12:38:00 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:00 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da 1G" returned: 0 in 0.924s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:00 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da Jul 06 12:38:00 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:01 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da" returned: 0 in 0.796s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:01 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da is being set with open permissions: ugo+rw Jul 06 12:38:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:01 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da Jul 06 12:38:01 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:02 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da" returned: 0 in 0.687s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:02 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.info Jul 06 12:38:02 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:03 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.info" returned: 0 in 0.735s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:03 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.info is being set with open permissions: ugo+rw Jul 06 12:38:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:03 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.info Jul 06 12:38:03 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:03 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.info" returned: 0 in 0.774s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.911s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:03 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-100a48e3-f143-4683-90ab-f1754c5c16b6 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-12d14e3c-41c4-4628-bf76-816db79d28da-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-12d14e3c-41c4-4628-bf76-816db79d28da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-12d14e3c-41c4-4628-bf76-816db79d28da" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-12d14e3c-41c4-4628-bf76-816db79d28da" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot 12d14e3c-41c4-4628-bf76-816db79d28da of volume bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[0954f3ed-2867-4195-b9e8-9af281fd6c70]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:04 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da Jul 06 12:38:04 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:05 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da" returned: 0 in 0.776s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:05 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:38:05 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fec60b-0630-4bfa-aba8-afa4f1d4c06a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:05 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f Jul 06 12:38:05 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:06 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" returned: 0 in 0.806s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:06 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da Jul 06 12:38:06 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:06 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da" returned: 0 in 0.819s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:06 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da Jul 06 12:38:06 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:07 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f.12d14e3c-41c4-4628-bf76-816db79d28da" returned: 0 in 0.701s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-12d14e3c-41c4-4628-bf76-816db79d28da" released by "_delete_snapshot" :: held 3.207s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" released by "delete_snapshot" :: held 3.231s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:07 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Created reservations ['6e60c6aa-58cf-47ae-94ec-68e905c1fc3d', 'ed64e6ff-d5ea-45d9-8522-9dea1339498b', '91dc0418-70db-4037-b2c7-180d4d0f0451', '3b0a2fd4-b97a-4043-9a81-42d31d5c9ef9'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:07 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:38:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-10df33e0-b535-4910-a89d-573e392ad565 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-12d14e3c-41c4-4628-bf76-816db79d28da-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Lock "cinder-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:08 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560096e-97c6-4f07-9785-fd09893206bf]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:08 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f Jul 06 12:38:08 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:09 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" returned: 0 in 0.905s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:09 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f Jul 06 12:38:09 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:10 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" returned: 0 in 0.701s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f" released by "delete_volume" :: held 1.690s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Created reservations ['f60db4ed-9efe-4dbf-b984-ede8bbe825e2', '914a925f-dcb4-4c05-ae69-e68f829adb6e', '957df69d-1ff2-4ef0-ae27-4cf17eb80019', '1a154f7e-0810-45f4-8d85-ee6db26e211b'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:10 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:10 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:38:10 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:11 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.814s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:11 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-a5296b00-d9d2-4e90-b233-3177181b0e3a tempest-ProjectMemberTests-1317769893 None] Lock "cinder-bc2a9ef2-3e4b-4b4b-b0e9-239ce9efc07f-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (9076e1e8-3125-4e1f-aa4b-9a441fc2d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260b2948-9efd-4982-af6b-e7aad0a5de30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260b2948-9efd-4982-af6b-e7aad0a5de30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367825335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93121c7e-efc7-4ab2-817b-23d3f40c391d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:11Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5ef36b-affc-4d13-a368-ffb8242dc83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5ef36b-affc-4d13-a368-ffb8242dc83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4048b5fc-6841-44de-8662-6c5d71d39fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4048b5fc-6841-44de-8662-6c5d71d39fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93121c7e-efc7-4ab2-817b-23d3f40c391d', 'volume_name': 'volume-93121c7e-efc7-4ab2-817b-23d3f40c391d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1bc7f4-d905-4409-bfb4-0a2425cb9d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1bc7f4-d905-4409-bfb4-0a2425cb9d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1a37a0-fca1-4798-8487-9423132b5df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:11 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Volume 93121c7e-efc7-4ab2-817b-23d3f40c391d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93121c7e-efc7-4ab2-817b-23d3f40c391d', 'volume_size': 1} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367825335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93121c7e-efc7-4ab2-817b-23d3f40c391d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:11Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Creating volume 93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:11 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:38:11 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:11 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d 1073741824 Jul 06 12:38:11 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:12 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d 1073741824" returned: 0 in 0.866s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:12 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:12 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d Jul 06 12:38:12 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:13 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d" returned: 0 in 0.712s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1a37a0-fca1-4798-8487-9423132b5df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93121c7e-efc7-4ab2-817b-23d3f40c391d', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374ac6cf-cbd7-4c8e-84a9-867c150b3a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:13 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Volume volume-93121c7e-efc7-4ab2-817b-23d3f40c391d (93121c7e-efc7-4ab2-817b-23d3f40c391d): created successfully Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374ac6cf-cbd7-4c8e-84a9-867c150b3a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (9076e1e8-3125-4e1f-aa4b-9a441fc2d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:13 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-13276b59-3ed0-4672-bf49-d4e4d35650f4 tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot b86ab210-758c-4539-a886-90c14972412f of volume 93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c95affe-023e-48f9-9b4d-87a1704d2665]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:13 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:13 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d Jul 06 12:38:13 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:14 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d" returned: 0 in 0.812s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:14 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:14 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f 1G Jul 06 12:38:14 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:15 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f 1G" returned: 0 in 0.823s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:15 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93121c7e-efc7-4ab2-817b-23d3f40c391d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:15 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93121c7e-efc7-4ab2-817b-23d3f40c391d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f Jul 06 12:38:15 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:16 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93121c7e-efc7-4ab2-817b-23d3f40c391d -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f" returned: 0 in 0.767s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:16 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f is being set with open permissions: ugo+rw Jul 06 12:38:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:16 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f Jul 06 12:38:16 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:16 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f" returned: 0 in 0.709s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:16 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:16 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.info Jul 06 12:38:16 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:17 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.info" returned: 0 in 0.705s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:17 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.info is being set with open permissions: ugo+rw Jul 06 12:38:17 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:17 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.info Jul 06 12:38:17 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:18 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.info" returned: 0 in 0.664s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:18 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.568s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:18 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-3bbd3b64-0dac-493c-ad2c-5a153ecb4687 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:38:18 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-b86ab210-758c-4539-a886-90c14972412f-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Lock "cinder-b86ab210-758c-4539-a886-90c14972412f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-93121c7e-efc7-4ab2-817b-23d3f40c391d" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-93121c7e-efc7-4ab2-817b-23d3f40c391d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-b86ab210-758c-4539-a886-90c14972412f" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-b86ab210-758c-4539-a886-90c14972412f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot b86ab210-758c-4539-a886-90c14972412f of volume 93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9929e58-aba8-42e3-b8ca-e37b00a88317]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:19 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f Jul 06 12:38:19 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:19 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f" returned: 0 in 0.814s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93121c7e-efc7-4ab2-817b-23d3f40c391d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e309b08-6599-4485-89b1-556a649dbebe]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:19 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:20 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d Jul 06 12:38:20 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:20 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d" returned: 0 in 0.857s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:20 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:20 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f Jul 06 12:38:20 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:21 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f" returned: 0 in 0.849s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:21 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:21 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f Jul 06 12:38:21 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:22 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:22 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d.b86ab210-758c-4539-a886-90c14972412f" returned: 0 in 0.707s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-b86ab210-758c-4539-a886-90c14972412f" released by "_delete_snapshot" :: held 3.329s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-93121c7e-efc7-4ab2-817b-23d3f40c391d" released by "delete_snapshot" :: held 3.353s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:22 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Created reservations ['9fad9fe3-ab1b-4ec5-aa79-eb48d1ec07c1', '947c6169-5c93-4c23-912a-d254329d8ab0', 'e42161dd-1dee-43a4-9b56-8e12d93cc4a3', '2f5f62d4-3ace-4c0f-b128-0e61366f660a'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:22 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:38:22 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-312b56dc-62b0-4154-a7b1-e62c0f0c32bb tempest-ProjectMemberTests-1317769893 None] Lock "cinder-b86ab210-758c-4539-a886-90c14972412f-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-93121c7e-efc7-4ab2-817b-23d3f40c391d-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Lock "cinder-93121c7e-efc7-4ab2-817b-23d3f40c391d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-93121c7e-efc7-4ab2-817b-23d3f40c391d" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:23 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-93121c7e-efc7-4ab2-817b-23d3f40c391d" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:23 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ba095b-6e80-4d76-95fb-6b13e66bf339]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:23 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:23 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d Jul 06 12:38:23 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:24 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d" returned: 0 in 0.833s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:24 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:24 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d Jul 06 12:38:24 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:25 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-93121c7e-efc7-4ab2-817b-23d3f40c391d" returned: 0 in 0.768s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-93121c7e-efc7-4ab2-817b-23d3f40c391d" released by "delete_volume" :: held 1.664s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Created reservations ['897cdf08-2a02-4fca-9a58-d965284d7cc3', '3374deef-4bc6-41fc-b03d-07efe8d7d543', 'aac391d6-4456-4782-a523-95e5d9a6c6f3', '725ab3d5-2103-4dd3-8b4a-96e1382d9dab'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:25 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:25 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:38:25 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:26 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.774s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:26 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6e19aedf-b9f9-45fb-baee-e18462cd74bd tempest-ProjectMemberTests-1317769893 None] Lock "cinder-93121c7e-efc7-4ab2-817b-23d3f40c391d-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (fe324930-c748-4318-b14e-363e5a6f9d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e01cf2-6231-4d69-b523-57e4c1662604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e01cf2-6231-4d69-b523-57e4c1662604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057145875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f49cade-976b-4987-b01d-7fff48e168fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:26Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bc5f85-2958-4109-b60f-3e0d158bfe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bc5f85-2958-4109-b60f-3e0d158bfe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0364e128-5e9c-4f36-b5b9-78078ab2ee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0364e128-5e9c-4f36-b5b9-78078ab2ee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f49cade-976b-4987-b01d-7fff48e168fa', 'volume_name': 'volume-3f49cade-976b-4987-b01d-7fff48e168fa', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb96fdf-ea2b-40c4-a2bc-0f447f0431b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb96fdf-ea2b-40c4-a2bc-0f447f0431b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55de6a56-b4ba-466f-a45b-282f98f8d584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:26 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Volume 3f49cade-976b-4987-b01d-7fff48e168fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f49cade-976b-4987-b01d-7fff48e168fa', 'volume_size': 1} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057145875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f49cade-976b-4987-b01d-7fff48e168fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:26Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Creating volume 3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:26 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:38:26 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:26 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa 1073741824 Jul 06 12:38:26 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:27 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:38:27 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:27 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa 1073741824" returned: 0 in 0.960s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:27 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa Jul 06 12:38:27 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:27 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.746s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:38:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:38:28 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa" returned: 0 in 0.741s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55de6a56-b4ba-466f-a45b-282f98f8d584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f49cade-976b-4987-b01d-7fff48e168fa', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad1c1e6-7caf-4f64-bbbe-a60c4f938416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:28 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Volume volume-3f49cade-976b-4987-b01d-7fff48e168fa (3f49cade-976b-4987-b01d-7fff48e168fa): created successfully Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad1c1e6-7caf-4f64-bbbe-a60c4f938416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (fe324930-c748-4318-b14e-363e5a6f9d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:28 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2e6aa356-f0bf-4437-84a7-c2311ffcc393 tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot 6889b914-1298-412e-834d-85ae24b31b7f of volume 3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b97e92-866e-4701-a3af-9f00f836c5ee]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:28 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:28 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa Jul 06 12:38:28 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:29 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa" returned: 0 in 0.756s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:29 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:29 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f 1G Jul 06 12:38:29 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:30 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f 1G" returned: 0 in 0.783s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f49cade-976b-4987-b01d-7fff48e168fa -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:30 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f49cade-976b-4987-b01d-7fff48e168fa -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f Jul 06 12:38:30 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:30 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f49cade-976b-4987-b01d-7fff48e168fa -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f" returned: 0 in 0.676s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:30 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f is being set with open permissions: ugo+rw Jul 06 12:38:30 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:30 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f Jul 06 12:38:30 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:31 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f" returned: 0 in 0.632s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:31 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:31 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.info Jul 06 12:38:31 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:32 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.info" returned: 0 in 0.642s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:32 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.info is being set with open permissions: ugo+rw Jul 06 12:38:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:32 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.info Jul 06 12:38:32 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:32 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.info" returned: 0 in 0.653s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:32 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:32 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-81f17ec2-1512-49dc-8c40-aedba970768c tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:38:32 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:UPDATE=87,cinder:SELECT=61,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-6889b914-1298-412e-834d-85ae24b31b7f-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-6889b914-1298-412e-834d-85ae24b31b7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-3f49cade-976b-4987-b01d-7fff48e168fa" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-3f49cade-976b-4987-b01d-7fff48e168fa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-6889b914-1298-412e-834d-85ae24b31b7f" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-6889b914-1298-412e-834d-85ae24b31b7f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot 6889b914-1298-412e-834d-85ae24b31b7f of volume 3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbb2f1b-d77c-40f7-b400-bfe8396356f0]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:34 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:34 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f Jul 06 12:38:34 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:35 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f" returned: 0 in 0.878s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:35 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f49cade-976b-4987-b01d-7fff48e168fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:38:35 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda8645f-0fda-4ae2-9a65-13fc74db1146]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:35 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa Jul 06 12:38:35 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:35 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa" returned: 0 in 0.882s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:35 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:35 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f Jul 06 12:38:35 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:36 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f" returned: 0 in 0.818s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:36 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:36 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f Jul 06 12:38:36 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:37 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:37 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa.6889b914-1298-412e-834d-85ae24b31b7f" returned: 0 in 0.683s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-6889b914-1298-412e-834d-85ae24b31b7f" released by "_delete_snapshot" :: held 3.367s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-3f49cade-976b-4987-b01d-7fff48e168fa" released by "delete_snapshot" :: held 3.394s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:37 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=62,cinder:UPDATE=83,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:38:37 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Created reservations ['d867af9a-31d7-423c-bff0-51c5ba5be6a6', '3f2e630a-c6a6-4fda-b4cb-1d99f36a7e53', 'ae2fbbf3-4ee5-492c-921b-f0848a4ff2ea', '2eac4fc7-c588-4550-9fb1-97e4b5057f2c'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:37 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:38:37 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-90015709-dc3b-4490-8d98-9b74975f6b25 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-6889b914-1298-412e-834d-85ae24b31b7f-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-3f49cade-976b-4987-b01d-7fff48e168fa-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-3f49cade-976b-4987-b01d-7fff48e168fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-3f49cade-976b-4987-b01d-7fff48e168fa" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:38 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-3f49cade-976b-4987-b01d-7fff48e168fa" acquired by "delete_volume" :: waited 0.018s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:38 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[76035dd9-d30a-410b-bbbd-a11bb3904a5a]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:38 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:38 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa Jul 06 12:38:38 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:39 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa" returned: 0 in 0.818s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:39 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa Jul 06 12:38:39 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:39 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:39 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-3f49cade-976b-4987-b01d-7fff48e168fa" returned: 0 in 0.676s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:39 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-3f49cade-976b-4987-b01d-7fff48e168fa" released by "delete_volume" :: held 1.557s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:39 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Created reservations ['a616855b-077f-414c-a16b-dc5310dd9832', '8304b08e-3260-4cc0-ab8e-ab183d23ff9d', '3837d89f-626d-4605-b812-284e474692cd', 'ef149c22-5810-438c-ac63-1d86806269f2'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:40 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:38:40 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:40 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.645s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:40 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-98451b8f-ea0b-4d85-a092-d76fe2379ef5 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-3f49cade-976b-4987-b01d-7fff48e168fa-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:40 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (1ca4acbb-7aad-4f20-94fb-035f54fbc659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11ba992-9c87-4685-a038-d891bceabc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11ba992-9c87-4685-a038-d891bceabc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191220066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf6a1d7-3171-49f8-a29a-6ddcc34e1502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:41Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2ad6b4-eab2-4787-8e9f-05148b69d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2ad6b4-eab2-4787-8e9f-05148b69d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29067ffb-eaa0-43a7-9913-f311804c7596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29067ffb-eaa0-43a7-9913-f311804c7596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf6a1d7-3171-49f8-a29a-6ddcc34e1502', 'volume_name': 'volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d898e43b-3a15-4e70-aed7-96c8148ac572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d898e43b-3a15-4e70-aed7-96c8148ac572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae2a555-9e14-4f3d-a40d-be2dce3f9ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:41 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Volume adf6a1d7-3171-49f8-a29a-6ddcc34e1502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502', 'volume_size': 1} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191220066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf6a1d7-3171-49f8-a29a-6ddcc34e1502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:41Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Creating volume adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:41 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:41 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 1073741824 Jul 06 12:38:41 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:41 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 1073741824" returned: 0 in 0.800s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:41 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:41 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 Jul 06 12:38:41 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:42 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" returned: 0 in 0.631s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:42 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:42 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae2a555-9e14-4f3d-a40d-be2dce3f9ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67601575-2f4b-4da7-b8cb-1b22b65a39eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:42 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Volume volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 (adf6a1d7-3171-49f8-a29a-6ddcc34e1502): created successfully Jul 06 12:38:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67601575-2f4b-4da7-b8cb-1b22b65a39eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:42 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (1ca4acbb-7aad-4f20-94fb-035f54fbc659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:42 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-b356a493-897e-443c-ad7b-5caea0471fa0 tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:38:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:43 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot 884ec7a5-592c-43aa-8a37-b8f727003016 of volume adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:38:43 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3034d348-07c1-4d2f-aaa9-a5ef489d711d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:43 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:43 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 Jul 06 12:38:43 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:44 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" returned: 0 in 0.762s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:44 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 1G Jul 06 12:38:44 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:44 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 1G" returned: 0 in 0.800s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:44 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:44 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 Jul 06 12:38:44 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:45 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016" returned: 0 in 0.718s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:45 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 is being set with open permissions: ugo+rw Jul 06 12:38:45 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:45 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 Jul 06 12:38:45 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:46 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016" returned: 0 in 0.675s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:46 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.info Jul 06 12:38:46 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:46 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.info" returned: 0 in 0.636s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:46 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.info is being set with open permissions: ugo+rw Jul 06 12:38:46 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:46 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.info Jul 06 12:38:46 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:47 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.info" returned: 0 in 0.680s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:47 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.358s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:47 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-8d9c5967-508c-4435-b485-87654d1590f8 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-884ec7a5-592c-43aa-8a37-b8f727003016-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Lock "cinder-884ec7a5-592c-43aa-8a37-b8f727003016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-884ec7a5-592c-43aa-8a37-b8f727003016" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-884ec7a5-592c-43aa-8a37-b8f727003016" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot 884ec7a5-592c-43aa-8a37-b8f727003016 of volume adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[3186c47a-4440-4649-a4ce-5a1ea9053807]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:48 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:48 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 Jul 06 12:38:48 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:49 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016" returned: 0 in 0.903s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:49 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:38:49 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b302d5-008c-4a83-b79a-b6ec987a57b4]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:49 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:49 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 Jul 06 12:38:49 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:50 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" returned: 0 in 0.839s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:50 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:50 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 Jul 06 12:38:50 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:51 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016" returned: 0 in 0.803s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:51 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016 Jul 06 12:38:51 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:51 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:51 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502.884ec7a5-592c-43aa-8a37-b8f727003016" returned: 0 in 0.671s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-884ec7a5-592c-43aa-8a37-b8f727003016" released by "_delete_snapshot" :: held 3.368s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:51 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" released by "delete_snapshot" :: held 3.392s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:51 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Created reservations ['15e675d9-8685-4884-bc31-bc316b02665e', 'd9304156-7293-4642-8eae-4411424a55d7', '9f15656d-a26e-4560-87c2-db8a83347cda', '387ff6b3-8f13-403c-b871-10055684059c'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:52 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:38:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-92960b01-8fa0-48df-9a10-ee332b89eb1e tempest-ProjectMemberTests-1317769893 None] Lock "cinder-884ec7a5-592c-43aa-8a37-b8f727003016-delete_snapshot" released by "delete_snapshot" :: held 3.530s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-adf6a1d7-3171-49f8-a29a-6ddcc34e1502-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-adf6a1d7-3171-49f8-a29a-6ddcc34e1502-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:52 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" acquired by "delete_volume" :: waited 0.015s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:52 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1b60d0-7958-4154-b77a-fc52aa587b09]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:52 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:52 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 Jul 06 12:38:52 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:53 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" returned: 0 in 0.781s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:53 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:53 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502 Jul 06 12:38:53 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:54 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" returned: 0 in 0.652s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-adf6a1d7-3171-49f8-a29a-6ddcc34e1502" released by "delete_volume" :: held 1.492s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Created reservations ['a1676436-7e9f-4bb2-87ea-d8fd70d3b478', 'af1bbaf6-a973-4dfd-86a0-17b7c73c1dcf', 'b84947dd-5926-4c2e-9641-f8f5470053c2', '13d71922-9e16-4ea3-8bae-d64a6409db31'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:54 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:54 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:38:54 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:55 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.717s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:55 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-2dc981ed-0624-4734-b3f8-bf8000b66cd0 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-adf6a1d7-3171-49f8-a29a-6ddcc34e1502-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.flows.manager.create_volume [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86706) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (b5af7b93-c38d-41d8-a859-1aa94623e7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f37be38-1eff-4a10-856f-f16a5a6d4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f37be38-1eff-4a10-856f-f16a5a6d4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825501777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e7a9e4-d543-464f-b830-69dc6afa5775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:55Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0855f1d-4bc2-4c0e-a07f-3aa42e0d0361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0855f1d-4bc2-4c0e-a07f-3aa42e0d0361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0113593-5de7-4f0f-bc5e-f259b4ff85d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0113593-5de7-4f0f-bc5e-f259b4ff85d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e7a9e4-d543-464f-b830-69dc6afa5775', 'volume_name': 'volume-79e7a9e4-d543-464f-b830-69dc6afa5775', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e9f826-6a48-4c2e-b277-63ab7b3a8e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e9f826-6a48-4c2e-b277-63ab7b3a8e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37408c5c-98d5-4da4-8406-1ffb5575e592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Volume 79e7a9e4-d543-464f-b830-69dc6afa5775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e7a9e4-d543-464f-b830-69dc6afa5775', 'volume_size': 1} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825501777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e7a9e4-d543-464f-b830-69dc6afa5775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02888d9795144b7d93110d55c92b96b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:55Z,use_quota=True,user_id='d8b19b40586a4ef9a4cb368b89e96b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2526717b-635c-41d4-a21a-af8c9db266be),volume_type_id=2526717b-635c-41d4-a21a-af8c9db266be)}" {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Creating volume 79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Selected osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a as target Quobyte volume. {{(pid=86706) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:55 devstack cinder-volume[86706]: INFO cinder.volume.drivers.remotefs [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] casted to osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a Jul 06 12:38:55 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 1073741824 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:55 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 1073741824 Jul 06 12:38:55 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:56 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 1073741824" returned: 0 in 0.896s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:56 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:56 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 Jul 06 12:38:56 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:57 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775" returned: 0 in 0.668s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'} {{(pid=86706) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37408c5c-98d5-4da4-8406-1ffb5575e592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e7a9e4-d543-464f-b830-69dc6afa5775', 'volume_size': 1}' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3f905b-6f9c-4e47-b218-c53c41f93bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:57 devstack cinder-volume[86706]: INFO cinder.volume.flows.manager.create_volume [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Volume volume-79e7a9e4-d543-464f-b830-69dc6afa5775 (79e7a9e4-d543-464f-b830-69dc6afa5775): created successfully Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3f905b-6f9c-4e47-b218-c53c41f93bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86706) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Flow 'volume_create_manager' (b5af7b93-c38d-41d8-a859-1aa94623e7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86706) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:57 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-2511dfca-8f83-47b4-8872-e4c5c7b4301a tempest-ProjectMemberTests-1317769893 None] Created volume successfully. Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Creating offline snapshot 0a31bcc2-b908-4647-804e-f7ecb2e3dedb of volume 79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dc3e76-8a71-4b42-8d90-8f50d180eeaa]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:57 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:57 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 Jul 06 12:38:57 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:58 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775" returned: 0 in 0.746s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:58 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb 1G {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:58 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb 1G Jul 06 12:38:58 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:59 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb 1G" returned: 0 in 0.816s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:59 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e7a9e4-d543-464f-b830-69dc6afa5775 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:59 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e7a9e4-d543-464f-b830-69dc6afa5775 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb Jul 06 12:38:59 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:00 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e7a9e4-d543-464f-b830-69dc6afa5775 -F qcow2 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb" returned: 0 in 0.697s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:00 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb is being set with open permissions: ugo+rw Jul 06 12:39:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:00 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb Jul 06 12:39:00 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:00 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb" returned: 0 in 0.652s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:00 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:00 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.info Jul 06 12:39:00 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:01 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.info" returned: 0 in 0.656s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:01 devstack cinder-volume[86706]: WARNING cinder.volume.drivers.remotefs [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.info is being set with open permissions: ugo+rw Jul 06 12:39:01 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.info {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:01 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.info Jul 06 12:39:01 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:02 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.info" returned: 0 in 0.644s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:02 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.302s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:02 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-a5b02828-bf99-4893-8e7b-d5ae7668f981 tempest-ProjectMemberTests-1317769893 None] Create snapshot completed successfully Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-0a31bcc2-b908-4647-804e-f7ecb2e3dedb-delete_snapshot" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-0a31bcc2-b908-4647-804e-f7ecb2e3dedb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-79e7a9e4-d543-464f-b830-69dc6afa5775" by "delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-79e7a9e4-d543-464f-b830-69dc6afa5775" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-0a31bcc2-b908-4647-804e-f7ecb2e3dedb" by "_delete_snapshot" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-0a31bcc2-b908-4647-804e-f7ecb2e3dedb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Deleting offline snapshot 0a31bcc2-b908-4647-804e-f7ecb2e3dedb of volume 79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] snapshot_file for this snap is: volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb {{(pid=86706) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[db38741c-5061-4aa2-b58a-ed13e6e68c4d]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:03 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb Jul 06 12:39:03 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:03 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb" returned: 0 in 0.754s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.remotefs [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e7a9e4-d543-464f-b830-69dc6afa5775(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86706) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b18dd0-0d48-4e3c-8f8f-e084aed64a76]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:03 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:04 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 Jul 06 12:39:04 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:04 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775" returned: 0 in 0.758s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:04 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:04 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb Jul 06 12:39:04 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:05 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb" returned: 0 in 0.718s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:05 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:05 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb Jul 06 12:39:05 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:06 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:06 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775.0a31bcc2-b908-4647-804e-f7ecb2e3dedb" returned: 0 in 0.654s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-0a31bcc2-b908-4647-804e-f7ecb2e3dedb" released by "_delete_snapshot" :: held 2.983s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-79e7a9e4-d543-464f-b830-69dc6afa5775" released by "delete_snapshot" :: held 3.005s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:06 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Created reservations ['79355ec5-2ab6-4f6a-a881-a0b69d9397d1', 'b0a0b0bd-9416-4d6a-a5ea-c65d804b1406', 'dcf3add5-c503-4c06-bc50-e5f31bff331d', 'ba672b18-a4ff-461f-b6a9-877932c3eb87'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:06 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Delete snapshot completed successfully. Jul 06 12:39:06 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-6684f43b-0966-4b10-b018-f61e6f2bd8d7 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-0a31bcc2-b908-4647-804e-f7ecb2e3dedb-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-79e7a9e4-d543-464f-b830-69dc6afa5775-delete_volume" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-79e7a9e4-d543-464f-b830-69dc6afa5775-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "cinder-quobyte-79e7a9e4-d543-464f-b830-69dc6afa5775" by "delete_volume" {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:07 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-79e7a9e4-d543-464f-b830-69dc6afa5775" acquired by "delete_volume" :: waited 0.019s {{(pid=86706) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:07 devstack cinder-volume[86706]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e166cbf-f509-4e1d-8144-0a6807e7ed41]: (4, 'qcow2') {{(pid=87232) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:07 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:07 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 Jul 06 12:39:07 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:08 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775" returned: 0 in 0.773s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:08 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775 Jul 06 12:39:08 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:08 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:08 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313/volume-79e7a9e4-d543-464f-b830-69dc6afa5775" returned: 0 in 0.698s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:08 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-quobyte-79e7a9e4-d543-464f-b830-69dc6afa5775" released by "delete_volume" :: held 1.532s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:08 devstack cinder-volume[86706]: DEBUG cinder.quota [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Created reservations ['170f79c4-1a46-45d5-bc86-479951f4b993', 'b108204b-b276-454a-a3f0-942bf342233e', '4c134210-7706-4fae-ac62-baea318ea1ff', '6125a617-8da8-4a3b-917c-932a7ba98ada'] {{(pid=86706) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:09 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:39:09 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:09 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.718s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:09 devstack cinder-volume[86706]: INFO cinder.volume.manager [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Deleted volume successfully. Jul 06 12:39:09 devstack cinder-volume[86706]: DEBUG cinder.coordination [None req-63c15c93-6044-4aae-a517-ab52f2f3ba85 tempest-ProjectMemberTests-1317769893 None] Lock "cinder-79e7a9e4-d543-464f-b830-69dc6afa5775-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86706) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:19 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=39,cinder:INSERT=12,cinder:UPDATE=54,cinder:DELETE=1 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:39:19 devstack cinder-volume[86706]: DEBUG dbcounter [-] [86706] Writing DB stats cinder:SELECT=35,cinder:INSERT=16,cinder:UPDATE=45,cinder:DELETE=6 {{(pid=86706) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a': None} {{(pid=86706) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG cinder.volume.drivers.quobyte [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aecd9d1-e8c9-4275-abca-1fcabb506b5a'] {{(pid=86706) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.lockutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86706) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:27 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313 Jul 06 12:39:27 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:27 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG oslo_concurrency.processutils [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a1c796690070b1a61bd38adf6c81313" returned: 0 in 0.684s {{(pid=86706) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG cinder.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Notifying Schedulers of capabilities ... {{(pid=86706) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG oslo_service.periodic_task [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] Running periodic task VolumeManager._thread_info {{(pid=86706) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread count: 28 {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:39:27 devstack cinder-volume[86706]: DEBUG cinder.volume.manager [None req-687b8a78-fd6a-4765-ac47-9c1ce29ffc66 None None] thread info: [<_MainThread(MainThread, started 129873609183360)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86706) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}